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Abstract  of  Dissertation  Presented  to  the  Graduate  School 
of  the  University  of  Florida  in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of  Doctor  of  Education 

DIFFERENCES  IN  PERCEPTIONS  OF  SCHOOL  EFFECTIVENESS 
AT  THE  MIDDLE  AND  HIGH  SCHOOL  LEVELS 

By 

James  Subbs 
May  1995 

Chairman:  Dr.  James  W.  Hensel 

Major  Department:  Educational  Leadership 

The  purpose  of  this  study  was  to  determine  whether 
differences  exist  in  the  perceptions  of  school  effectiveness 
at  the  middle  and  high  school  levels.  Perceptions  of  school 
effectiveness  as  measured  by  a reliable  and  valid  survey  were 
compared  between  middle  and  high  school  respondents  for 
teachers,  students,  and  parents. 

The  population  consisted  of  680  teachers,  4,608 
students,  and  1,626  parents.  The  t-test  for  independent 
samples  was  used  to  determine  if  significant  (p  < .05) 
differences  occurred.  The  t-test  results  between  middle  and 
high  school  teachers  found  statistical  differences  on  three 
characteristics  of  school  effectiveness:  instructional 

leadership,  parent /community  involvement,  and  strong 
professional  development.  Differences  were  found  between 
middle  and  high  school  students  for  all  seven  school 
effectiveness  characteristics:  safe  and  orderly  environment. 
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positive  school  climate,  high  expectations,  frequent 
assessment /monitoring  of  student  achievement,  emphasis  on 
basic  skills,  maximum  opportunities  for  learning,  and 
parent /community  involvement.  The  t-test  results  between 
middle  school  and  high  school  parents  identified  statistical 
differences  for  seven  of  nine  characteristics:  clear  and 

focused  mission,  safe  and  orderly  environment,  positive 
school  climate,  high  expectations,  frequent 
assessment /monitoring  of  student  achievement,  maximum 
opportunities  for  learning,  and  parent/community  involvement. 

Significant  differences  between  the  levels  of  teachers, 
students,  and  parents  for  these  characteristics  suggest 
different  remedies  for  school  improvement  efforts  at  the 
middle  and  high  school  levels.  The  following  recommendations 
were  made  as  a result  of  this  study:  (a)  principals  should 

develop  an  action  plan  for  disseminating  building  level 
survey  results.  The  action  plan  should  include  activities  to 
address  those  characteristics  with  means  below  the  distric 
midpoint;  (b)  schools  should  establish  an  effectiveness  team 
of  teachers,  students,  and  parents  to  review  and  make 
meaningful  use  of  survey  data;  (c)  schools  should  create  a 
learning  environment  that  is  open,  friendly,  and  culturally 
inviting;  (d)  schools  should  improve  parent  participation  by 
establishing  good  communication  between  the  school  and  home; 
(e)  teachers  should  engage  students  in  learning  by  involving 
students  in  discussing  issues  related  to  the  topic  as  well  as 
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writing  about  personal  experiences,  creating  original 
stories,  and  solving  complex  problems. 


IX 


CHAPTER  1 
INTRODUCTION 

The  topic  of  school  effectiveness  is  particularly  timely 
as  public  attention  is  once  again  being  directed  to  the 
purposes  and  effectiveness  of  the  nation's  schools.  The 
demand  of  educational  reform  and  accountability  appears  to  be 
a recurring  theme  that  has  garnered  strong  public  and  private 
support  during  the  last  20  years.  Corcoran  (1985)  reported 
that  during  the  early  1970s,  public  attention  was  focused  on 
the  results  of  studies  of  schools  by  blue-ribbon  panels, 
foundations,  and  national  educational  organizations.  The 
studies  concluded  that  American  schools  were  in  trouble 
because  they  were  inhumane,  too  rigid,  and  viewed  as  dull 
authoritarian  places  with  offerings  often  unrelated  to  the 
needs  of  either  students  or  communities.  He  proposed  that 
student  choice,  greater  individualization  of  programming, 
more  community  involvement,  better  career  preparation, 
earlier  school-leaving  age,  and  smaller  schools  would  serve 
as  remedies  to  improve  education  (p.  7) . 

Since  the  mid-1980s,  efforts  to  improve  education  have 
increasingly  focused  on  what  are  known  as  "effective  schools" 
programs.  Halderson,  Kelley,  Keefe,  and  Berge  (1989)  made 
the  point  that  effective  schools  have  the  same 
characteristics  as  successful  societies  or  organizations, 
including  a sense  of  purpose  and  security,  and  leadership 
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that  provides  a vision  for  the  future.  Researchers  who  have 
studied  what  are  known  as  effective  schools  have  identified 
certain  sociological  characteristics  as  correlates  of 
effectiveness.  Effective  school  policies  and  programs  have 
been  developed  by  many  state  and  local  education  agencies. 

These  programs  have  attracted  considerable  public  and 
professional  attention  and  have  become  a popular  topic  for 
education  news  stories  and  professional  publications.  Lively 
debate  among  researchers  and  other  educators  has  generated 
questions  about  the  merit  of  effective  school  programs  and 
the  research  base  on  which  the  programs  rest.  The  effective 
schools  movement  appears  to  be  a major  national  phenomenon  in 
public  education  and  a new  approach  to  school  reform  and 
accountability . 

Professional  opinion  supports  the  use  of  new  and 
innovative  methods  to  bring  about  reform  in  the  face  of  a 
changing  society.  Shanker  (1990)  likened  the  efforts  to 
reform  educational  systems  through  the  old  model,  a regimen 
of  tough  business-like  regulation  of  standards,  to  that  of 
stepping  up  an  old  assembly  line  that  is  hopelessly 
inadequate.  Shanker  questioned  reforms  that  rely  on  an  ill- 
founded  faith  in  a traditional  model  of  education  that  is  not 
only  outdated,  but  no  longer  functional.  Fifty  years  ago,  he 
noted,  times  were  simpler,  broken  families  were  unusual, 
parents  pushed  their  children  to  excel,  mothers  stayed  at 
home,  commercial  television  did  not  exist,  and  drug  abuse  was 
practically  unknown.  Even  under  these  conditions,  only  20% 
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of  public  school  students  graduated  from  high  school,  and  not 
until  1953  did  a majority  graduate  (p.  347). 

Researchers,  governmental  officials,  policy  makers,  and 
educators  have  been  searching  for  indicators  to  gauge  the 
health  of  this  nation's  schools.  Smith  (1988)  pointed  out 
that  one  of  the  startling  findings  that  emerged  from  A Nation 
at  Risk,  by  the  National  Commission  on  Excellence  in 
Education  (1983),  was  the  dismal  condition  of  public 
education  in  this  country.  The  nation's  governors  decided 
that  one  of  the  national  goals  for  education  should  be  to 
make  the  United  States  first  in  the  world  in  math  and  science 
by  the  year  2000  (USDOE,  1991,  p.  3).  They  appeared  to  want 
this  competition  based  on  test  results.  Bracey  (1991)  stated 
that  if  indicators  other  than  test  scores  are  considered,  the 
United  States  already  leads  the  world  in  science, 
mathematics,  and  technology.  Bracey  (1991)  revealed  that 
Americans  accounted  for  more  than  40%  of  all  professional 
articles  published  in  science  publications.  The  number  of 
degrees  awarded  in  engineering,  physical  science,  and 
mathematics  had  grown  from  90,000  to  more  than  175,000  in 
1987,  despite  the  shrinking  population  of  traditional 
college-aged  students  (p.  114). 

The  Secretary's  Commission  on  Achieving  Necessary  Skills 
(SCANS,  1991)  was  asked  to  examine  the  demands  of  the 
workplace  and  whether  our  young  people  are  capable  of  meeting 
those  demands.  What  the  commission  found  was  disturbing. 

More  than  half  of  our  young  people  leave  school  without  the 
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knowledge  or  foundation  required  to  acquire  and  retain  a good 
job  (SCANS  REPORT,  1991) . The  SCANS  report  sends  a strong 
message  that  public  education  must  react  to  the  needs  of  a 
changing  society  and  workplace.  Basic  skills  alone  are  not 
sufficient  for  most  work  in  the  21st  century,  where  the  labor 
force  and  citizenry  must  think  for  a living. 

If  one  accepts  the  view  that  schools  are  complex  social 
systems  and  a reflection  of  society,  one  must  consider  the 
issue  of  time  in  measuring  school  effectiveness.  The 
importance  of  viewing  schools  and  how  they  change  over  time 
is  fundamental  in  any  sound  approach  to  measuring  school 
effectiveness.  Rowan,  Bossert,  and  Dwyer  (1983)  reported 
that  many  researchers  often  take  a snapshot  of  1 year's 
achievement  and  label  a school  as  effective  or  ineffective  on 
the  basis  of  such  a limited  database. 

The  history  of  the  search  for  effective  schools  that  has 
pervaded  the  field  of  education  for  the  past  decade  reveals 
no  consensus  on  definition  of  school  effectiveness.  Although 
much  has  been  written,  we  still  do  not  have  a definite  answer 
to  the  question,  what  constitutes  an  effective  school? 

Measuring  school  effectiveness  is  a complex  task.  A 
review  of  literature  related  to  studies  of  effective  schools 
reveals  that,  historically,  the  most  widely  used  measure  for 
assessing  school  effectiveness  has  been  student  scores  on 
standardized  tests  of  basic  skills.  Westbrook  (1982) 
reported  that  most  researchers  have  defined  effectiveness  in 
terms  of  measurable  student  outcomes,  noting  that  the  quality 
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of  the  school's  product,  the  student,  is  the  most  critical 
element  of  the  effective  school  (p.  7). 

Clauset  and  Gaynor  (1982)  defined  an  effective  school  as 
one  in  which  the  achievement  gap,  with  respect  to  grade-level 
standards  for  initially  low-achieving  students,  is  closed 
over  time.  Brookover  (1979)  analyzed  the  characteristics  of 
an  effective  school  and  found  that  they  are  not  isolated 
components,  but  rather  are  integrated  and  must  be  considered 
as  a whole.  He  further  stated  that  definitions  of 
effectiveness  should  encompass  qualitative  variables  such  as 
school  climate,  instructional  leadership,  high  expectations, 
business  and  community  support,  and  quantitative  variables 
such  as  achievement  scores  (p.  4) . 

Demographic  characteristics  of  the  community  and 
particular  needs  of  the  school  should  also  be  weighed 
carefully  when  defining  effectiveness.  A great  deal  of  the 
impetus  for  the  effective  schools  movement  originated  in 
public  concerns  over  the  issue  of  equal  educational 
opportunity  for  poor  and  minority  students;  however, 
definitions  that  focus  exclusively  on  data  grouped  by 
socioeconomic  status  (SES)  or  race  may  not  be  applicable  to 
high  SES  schools. 

Professional  articles  and  professional  practice  verify 
the  need  for  school  leaders  to  have  some  way  to  measure 
school  effectiveness  in  order  to  plan  for  school 
improvement.  Surveys  and  research  by  professional 
organizations  and  authors/researchers,  such  as  Phi  Delta 
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Kappa's  annual  Gallop  Poll  from  1969-1993  and  Klitgaard  and 
Hall's  Exemplary  School  Research  (1973),  all  reported  a low 
rating  of  satisfaction  with  certain  elements  of  public 
education.  After  a 10-year  study,  Wynn  (1981)  concluded  in 
1980,  described  characteristics  associated  with  "good" 
schools.  Noneducational  agencies,  such  as  Newsweek  (Williams 
1983),  and  U.S.  News  & World  Report  (Solarzano  1984)  also 
publicized  the  consistent  lack  of  satisfaction  with  public 
education,  citing  a plethora  of  reasons. 

Statement  of  the  Problem 

There  is  a need  to  investigate  teacher,  student,  and 
parent  perceptions  regarding  school  effectiveness 
characteristics  at  the  middle  and  high  school  levels.  If 
differences  exist,  they  may  indicate  a gap  in  commonality  of 
thought  and  purpose  of  services.  Differences  may  also 
indicate  a difficult  transition  for  students  as  they  progress 
from  middle  school  to  high  school.  Such  a gap  in  perceptions 
of  school  effectiveness  may  foster  a misunderstanding  of 
educational  outcomes  or  hinder  the  change  process  that  makes 
school  improvement  possible. 

Additionally,  there  is  a need  to  investigate  the 
differences  between  teachers,  students,  and  parents  in  middle 
and  high  schools.  Such  an  investigation  may  provide 
information  to  help  district  decision  makers  plan  program 
improvements.  In  addition,  this  information  may  be  used  in 
funding  decisions.  Such  improvements  will  also  support 
accountability  by  providing  data  to  plan  wise  use  of  monies. 
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make  critical  decisions,  staff  schools  appropriately,  and 
support  school  improvement  efforts. 

Purpose  of  the  Study 

The  primary  purpose  of  the  study  was  to  determine 
whether  differences  exist  in  the  perceptions  of  individuals 
regarding  measures  of  school  effectiveness  at  the  middle 
school  and  high  school  level.  Teacher,  student,  and  parent 
perceptions  of  school  effectiveness  at  the  middle  school 
level  were  compared  with  teacher,  student,  and  parent 
perceptions  of  school  effectiveness  at  the  high  school  level. 

A second  purpose  of  the  study  was  to  assist  school 
administrators  to  develop  a reporting  system  for  providing 
necessary  information  to  improve  the  effectiveness  of 
district  schools  and  to  provide  information  from  sources 
other  than  achievement  tests. 

Research  Questions  Under  Investigation 

The  study  was  to  determine  if  differences  existed 
between  the  perceptions  of  teachers,  students,  and  parents  in 
two  levels  of  secondary  schools.  More  specifically,  answers 
to  the  following  questions  were  sought: 

1.  Are  there  significant  differences  in  perceptions 
between  middle  and  high  school  teachers  on  each  of  the 
following  characteristics  of  school  effectiveness? 

(a)  Instructional  leadership 

(b)  Clear  and  focused  mission 

(c)  Safe  and  orderly  environment 

(d)  Positive  school  climate 
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(e) 

High  expectations 

(f) 

Frequent  assessment /monitoring  of  student 
achievement 

(g) 

Emphasis  on  basic  skills 

(h) 

Maximum  opportunities  for  learning 

(i) 

Parent /community  involvement 

(j) 

Strong  professional  development 

(k) 

Teacher  involvement  in  decision  making 

2 . Are  there  significant  differences  in  perceptions 
between  middle  and  high  school  students  on  each  of  the 


following 

characteristics  of  school  effectiveness? 

(a) 

Safe  and  orderly  environment 

(b) 

Positive  school  climate 

(c) 

High  expectations 

(d) 

Frequent  assessment/monitoring  of  student 
achievement 

(e) 

Emphasis  on  basic  skills 

(f) 

Maximum  opportunities  for  learning 

(g) 

Parent/community  involvement 

3. 

Are  there  significant  differences  in  perceptions 

between  middle  and  high  school  parents  on  each  of  the 


following 

characteristics  of  school  effectiveness? 

(a) 

Instructional  leadership 

(b) 

Clear  and  focused  mission 

(c) 

Safe  and  orderly  environment 

(d) 

Positive  school  climate 

(e) 

High  expectations 
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(f)  Frequent  assessment /monitoring  of  student 
achievement 

(g)  Emphasis  on  basic  skills 

(h)  Maximum  opportunities  for  learning 

(i)  Parent /community  involvement 

Definition  of  Terms 

The  following  terms  are  defined  for  the  purpose  of  this 
study: 

Effectiveness  refers  to  how  well  a program  is 
accomplishing  its  purpose  and  objectives.  It  is  the  degree 
to  which  the  plans  or  goals  of  an  individual  or  organization 
are  successfully  implemented  and  are  related  to  producing  a 
desired  or  intended  outcome. 

Middle  school  is  a school  established  and  organized  for 
teaching  pupils  on  any  grade  level  from  sixth  grade  through 
eighth  grade  (OCPS,  1993) . 

High  school  is  a school  established  and  organized  for 
teaching  pupils  on  any  grade  level  from  ninth  grade  through 
twelfth  grade  (OCPS,  1993). 

School  effectiveness  is  the  general  term  used  to 
describe  the  sociological  characteristics  of  schools  that  are 
considered  successful.  Successful  schools  have  the  same 
characteristics  as  successful  societies  or  organizations, 
including  a sense  of  purpose,  security,  and  leadership  that 
provides  a vision  of  purpose  for  the  future  (Halderson  et 


al. , 1989) . 
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School  improvement  is  the  general  term  applied  to 
efforts  made  by  individual  schools  to  improve  programs, 
services,  facilities,  or  other  essential  elements  of  schools 
(Florida  DOE,  1992) . 

School  Effectiveness  Characteristics  and  Indicators 
Questionnaire  is  a statistically  validated  67-item  instrument 
developed  by  the  Orange  County  Public  School  system  for  the 
purpose  of  measuring  teacher  perceptions  in  relation  to  11 
characteristics  that  describe  effective  schools  (Coney, 

1990)  . 

Delimitations 

The  following  delimitations  were  imposed  on  the  research 
design: 

1.  The  study  was  confined  to  a maximum  of  20  middle 
schools  and  10  high  schools  in  Orange  County  Public  Schools, 
Orlando,  Florida,  in  operation  during  the  1992-93  school 
year . 

2.  Data  regarding  perceptions  of  teachers,  students, 
and  parents  about  school  effectiveness  were  confined  to  those 
gathered  from  each  school  using  a statistically  validated 
school  effectiveness  instrument. 

3 . No  attempt  was  made  to  control  for  socioeconomic 
status,  sex,  and  ethnicity  of  respondents. 

Limitations 

Due  to  the  nature  of  this  study,  the  following 
limitations  were  imposed  on  the  research  design. 
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1.  The  accuracy  of  the  data  was  limited  by  the 
perceptions  of  the  voluntary  respondents  to  the  school 
effectiveness  instrument. 

2.  External  validity  can  be  established  to  the  degree 
that  generalizations  drawn  from  the  study  are  applied  to  a 
school  district  similar  to  the  Orange  County  Public  School 
System. 

3.  External  validity  was  limited  due  to  the 
nonrandomness  of  the  sample,  since  schools  as  well  as 
respondents  were  voluntary. 

Rationale 

For  several  decades,  the  dominant  measure  of  a school's 
educational  effectiveness  has  been  the  standardized  test. 
Research  on  the  measurements  of  school  effectiveness 
originally  focused  on  using  standardized  achievement  tests. 
However,  this  body  of  research  overlooked  a variety  of 
factors  that  constitute  effectiveness  (Rowan  et  al . , 1983). 
Although  standardized  tests  are  still  the  most  common  means 
of  assessing  how  well  a school  district  is  doing  its  job, 
they  do  not  assess  many  other  pertinent  factors.  For 
example,  standardized  tests  do  not  measure  the  perceptions  of 
the  individuals  who  work  and  learn  within  the  school 
environment,  nor  do  they  assess  the  views  of  parents  who 
expect  the  school  to  provide  their  children  with  a quality 
education.  In  the  Orange  County  Public  School  (OCPS)  system, 
school  effectiveness  survey  data  are  analyzed  by 
characteristics  by  individual  schools  to  develop  a reporting 
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system  for  providing  necessary  information  to  improve  the 
effectiveness  of  district  schools  and  to  provide  information 
from  sources  in  addition  to  standardized  achievement  tests. 
Analyses  of  teacher,  student,  and  parent  responses  to  survey 
questionnaires  are  reported  to  principals  and  other  decision 
makers  at  each  school.  Principals,  assistant  principals, 
teachers,  parents,  and  community  members  may  use  this 
information  in  planning  for  individual  school  improvement. 
Additionally,  schools  operate  differently  at  the  elementary, 
middle,  and  high  school  levels.  Yet,  there  are  instances  in 
which  district  policy  considers  the  levels  to  be  similar. 

There  is  a need  for  an  indepth  study  of  the  differences  in 
perceptions  of  individuals  closely  associated  with  schools 
concerning  effective  schools  at  the  middle  and  high  school 
levels  within  a district  in  order  to  guide  the  development  of 
district  policy. 

Organization  of  the  Study 

A review  of  literature  related  to  school  effectiveness 
is  presented  in  Chapter  2.  The  research  design  and  method 
for  analysis  are  presented  in  Chapter  3 . The  data  from 
school  effectiveness  survey  questionnaires  are  analyzed  in 
Chapter  4.  Chapter  5 consists  of  the  conclusions  and 
recommendations  gained  from  this  investigation. 


CHAPTER  2 

REVIEW  OF  RELATED  LITERATURE 
Introduction 

A broad  review  of  educational  literature  reflects  that 
educators  have  serious  concerns  about  the  notion  of  exactly 
what  makes  a school  effective  (i.e.,  how  can  the  differences 
between  an  effective  school  and  a school  not  considered 
effective  be  objectively  measured?).  A review  of  literature 
related  to  school  effectiveness  and  school  improvement 
revealed  a plethora  of  citations  on  the  topic.  Review  of 
those  citations  indicates  a national  preoccupation  with 
measuring,  determining,  and  demonstrating  effectiveness  as  a 
method  of  addressing  the  accountability  issue. 

Although  the  review  of  literature  yielded  a variety  of 
articles  about  school  effectiveness,  few  articles  described 
process-product  research,  research  processes,  or  data-driven 
projects  that  were  implemented  after  the  development  and 
acceptance  of  specific  school  effectiveness  measures.  Most 
of  the  articles  reviewed  fell  under  the  category  of  opinion 
of  the  experts  and  described  indicators  or  characteristics  of 
effective  schools,  as  well  as  anecdotal  reports  of  school 
improvement.  The  researcher  identified  numerous  articles 
related  to  school  effectiveness  contributed  by  both  educators 
and  noneducators.  Because  the  review  of  related  literature 
encompassed  a broad  base,  articles  and  reports  were  grouped 
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into  two  interrelated  areas  to  support  the  rationale  of  the 
study,  (a)  public  and  professional  support  for  reform  in 
education,  and  (b)  school  effectiveness  research. 

Public  and  Professional  Support  for  Reform  in  Education 

A review  of  literature  indicates  that  for  several 
decades  the  public  at  large,  as  well  as  the  educational 
community,  has  been  concerned  with  the  goal  of  improving 
public  education.  This  concern  became  evident  as  the  popular 
press  gave  attention  to  the  issues  of  public  education  and  as 
leading  educators  published  articles  encouraging  school 
reform. 

A review  of  the  literature  regarding  citizen 
satisfaction  with  public  education  testifies  to  the  fact 
that,  consistently  for  the  past  20  years,  the  majority  of 
Americans  expressed  increasing  levels  of  dissatisfaction  with 
public  education.  One  source  of  feedback  about  people's 
perceptions  toward  public  schools  is  provided  by  the  Gallop 
Poll  of  Education  (Elam,  1990),  which  has  conducted  an  annual 
national  poll  of  the  public's  attitudes  toward  the  public 
schools  since  1969.  Each  year  national  panels  have  been 
formed  to  suggest  questions  for  the  poll.  The  report 
published  annually  in  Phi  Delta  Kaooan  provides  reliable 
information  concerning  trends  in  opinions  about  important 
educational  issues.  Since  1979  these  annual  polls  have 
probed  the  sensitive  issue  of  parental  choice  of  schools.  In 
that  year,  parents  were  asked  if  they  would  send  their  eldest 
child  to  a public  school  different  from  the  school  that  child 
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currently  attended.  The  great  majority  of  parents  (78%) 
whose  eldest  child  was  12  or  younger  said  no;  only  12%  said 
yes.  In  1986,  however,  two  related  questions  were  asked, 
with  considerable  different  results.  In  that  year,  68%  of 
public  school  parents  polled  said  they  wished  they  had  the 
right  to  choose  the  public  schools  their  children  would 
attend,  while  25%  said  they  did  not.  In  1990,  62%  of  public 
school  parents  polled  said  the  wished  they  had  the  right  to 
choose  the  public  schools  their  children  would  attend  (pp. 
42-43).  The  continued  lower  rate  of  satisfaction  with  public 
education  appeared  in  the  yearly  Gallop  Poll  of  Education 
(Elam,  1990) . While  serving  as  the  editor  of  Phi  Delta 
Kaooan . Elam  formulated  the  following  Gallop  Poll  questions 
to  determine  public  attitudes  toward  public  schools: 

1.  Students  are  often  given  the  grades  A,  B,  C,  D,  and 
Fail  to  denote  the  quality  of  their  work.  Suppose 
the  public  schools  themselves,  in  this  community, 
were  graded  in  the  same  way.  What  grade  would  you 
give  the  public  schools  here  --A,  B,  C,  D,  or  Fail? 

2 . How  about  the  public  schools  in  the  nation  as  a 
whole?  What  grade  would  you  give  the  public  schools 
nationally--A,  B,  C,  D,  or  Fail?  (p.  51) 

Gallop  Poll  results  over  the  past  years  substantiate 
statistically  significant  changes  in  the  ratings  people  give 
the  local  public  schools  (Elam,  1990) . On  two  occasions, 
first  in  1988  and  again  in  1990,  Gallop  interviews  asked 
people  whether  they  think  the  public  schools  in  their 
communities  have  improved,  gotten  worse,  or  stayed  about  the 
same  over  the  preceding  5 years.  This  question  is  intended 
to  determine  whether  people  believe  the  current  wave  of 
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school  reform  has  been  successful.  Evidently,  not  many  do. 
Whereas  29%  of  those  surveyed  in  1988  saw  improvement  over 
the  preceding  5 years,  only  22%  did  so  in  1990  (Elam,  1990) . 

A low  point  in  education  came  just  after  A Nation  At 
Risk  by  the  National  Commission  on  Excellence  in  Education 
(1983)  was  released  and  widely  publicized  by  the  media.  That 
year,  only  31%  of  the  Gallop  Education  poll  respondents  gave 
local  schools  an  "A"  or  a "B."  Even  allowing  for  some 
sampling  error,  the  drop  of  17  percentage  points  in  approval 
ratings  between  1974  and  1983  represents  a negative  shift  in 
the  opinion  of  millions  of  Americans  (p.  50) . 

Since  1983,  there  has  been  some  gain  in  level  of 
satisfaction.  The  1993  Phi  Delta  Kappa/Gallop  Poll 
registered  the  largest  1-year  improvement  in  the  grades  given 
by  public  schools  since  the  question  was  first  asked  in  1974. 
The  percentage  of  respondents  awarding  A‘s  or  B's  jumped  from 
40%  in  1992  to  47%  in  1993,  after  a decade  of  relative 
stability  (Elam,  Rose,  & Gallop,  1993).  Recent  polls, 
conducted  by  contracted  services  for  the  OCPS  with  items 
parallel  to  many  Gallop  Poll  items,  indicate  similar  levels 
of  satisfaction  with  the  Orange  County  Public  Schools  (OCPS, 
1991,  1993). 

Schools  continue  to  encompass  complex  environments 
comprised  of  interacting  factors  that  combine  to  create  an 
effective  or  ineffective  climate  for  learning.  Educators 
have  traditionally  believed  that  schools  can  enhance  student 
learning  through  the  actions  they  take.  The  Equality  of 
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Educational  Opportunity  Study,  mandated  by  the  Congress  in 
the  Civil  Rights  Act  of  1964,  was  conducted  by  Coleman  (1966) 
and  others.  The  Coleman  report  (1966)  concluded  that  "school 
resources  have  little  impact  on  student  achievement  that  is 
independent  of  the  student's  family  background  and 
socioeconomic  status"  (p.  87).  These  conclusions  shocked  and 
dismayed  many  educators.  As  a reaction,  educational 
expectations  were  lowered.  Educators  saw  the  outcome  of 
educating  students  as  hopeless  when  there  was  little 
the  schools  could  do  to  compensate  for  the  effects  of 
nonschool  factors  on  student  achievement. 

Subsequently,  educators  challenged  the  finding  that 
there  was  little  the  schools  could  do  to  compensate  for  the 
effects  of  nonschool  factors  on  student  achievement.  Due  to 
the  lack  of  data  to  support  their  challenge,  research  that 
focused  on  the  identification  and  analysis  of  instructionally 
effective  schools  was  initiated.  Of  particular  concern  in 
many  of  the  research  studies  was  the  identification  of 
schools  that  were  unusually  effective  in  teaching  basic 
skills  to  poor  and  minority  children. 

Researchers  found  that  when  schools  were  matched  on 
student  background  and  socioeconomic  characteristics, 
differences  in  student  achievement  levels  of  schools 
corresponded  with  differences  in  school  management, 
instructional  processes,  and  learning  climate  (Robinson, 

1985,  p.  2).  The  basic  tenets  of  the  effective  schools 


movement  were  outlined  as  follows. 
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The  effective  schools  movement  is  framed  by  three 
central  assumptions:  (1)  schools  can  be  identified  that 
are  unusually  effective  in  teaching  poor  and  minority 
children  basic  skills  as  measured  by  standardized  tests; 
(2)  these  successful  schools  exhibit  characteristics 
that  are  correlated  with  their  success  and  that  lie  well 
within  the  domain  of  educators  to  manipulate;  (3)  the 
characteristics  of  successful  schools  provide  a basis 
for  improving  schools  not  deemed  to  be  successful  in  an 
appropriate  level  to  focus  educational  reform  efforts. 
(Robinson,  1985,  p.  23) 

Another  major  factor  leading  to  the  effective  school 
movement  was  provided  by  Bickel  (1983).  He  reported  that 
"the  hypercritical  message  concerning  school  effects 
delivered  by  many  educational  writers  during  the  previous 
decade  was  wearing  thin,  with  many  in  the  field  suspecting 
that  things  were  not  as  bad  as  they  had  been  depicted  in  some 
of  the  literature"  (p.  3).  Bickel  (1983)  concluded  that 
educators  were  ready  to  hear  a more  optimistic  message 
regarding  the  ability  of  schools  to  educate  children. 

Several  other  researchers,  including  Edmonds  (1979a, 
1979b,  1982)  and  Brookover  (1981)  have  advanced  the  effective 
schools  movement.  Edmonds  (1979a,  1979b,  1982)  concentrated 
efforts  on  identifying  and  analyzing  city  schools  that  had 
effective  instructional  programs  for  poor  and  minority 
children.  The  basic  principle  was  that  all  children  are 
eminently  educable  and  that  behavior  of  school  personnel  was 
the  critical  element  in  determining  quality  of  education. 

In  their  effective  schools  project,  Edmonds  and 
Frederiksen  (1978)  asked  the  following  question:  Are  there 

schools  that  are  instructionally  effective  for  poor  children? 
The  project  was  constructed  upon  an  earlier  study  involving 
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students  in  schools  in  Lansing  and  Detroit.  The  first  phase 
of  the  study  was  conducted  by  Lezotte,  Edmonds,  and  Ratner 
(1974)  in  Detroit's  model  cities  neighborhood.  All  20  of  the 
schools  involved  in  the  study  were  located  in  inner-city 
Detroit  and  served  a predominantly  poor  and  minority  student 
population.  An  effective  school  was  defined  as  a school  with 
the  student  body  being  at  or  above  the  city  average  grade 
equivalent  in  mathematics  and  reading.  An  ineffective  school 
was  defined  as  one  below  the  city  average. 

Edmonds  and  Frederiksen  (1978)  found  at  least  55 
effective  schools  in  the  northeast  quadrant  of  the  United 
States  that  were  included  in  the  1966  Educational  Opportunity 
Survey.  These  schools  varied  widely  in  racial  composition, 
per  pupil  expenditure,  and  other  determinants  of  school 
quality.  The  researchers  found  that  schools  that  were 
instructionally  effective  for  poor  and  black  children  were 
indistinguishable  from  schools  that  were  instructionally  less 
effective  on  measures  of  socioeconomic  background. 
Consequently,  the  major  differences  in  performance  between 
the  effective  and  ineffective  schools  were  not  attributed  to 
differences  in  the  social  class  and  family  background  of 
pupils  enrolled  in  schools  (p.  30). 

The  effective  schools  movement  was  initiated  as  a 
reaction  to  the  Coleman  report  (1966)  that  left  educators 
lowering  expectations  in  response  to  the  heavy  weighting 
placed  on  nonschool  factors  and  student  achievement.  Since 
that  time,  the  effective  schools  research  movement  has 
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broadened  to  study  characteristics  of  effectiveness  in  an 
effort  to  improve  schools. 

Effective  Schools  Research 

Robinson  (1985)  maintained  that  the  cluster  of  studies 
called  "the  effective  school  research  and  related  studies  on 
teaching  and  learning"  compose  the  most  important  body  of 
educational  information  to  be  developed  in  the  past  two 
decades . 

This  research  was  important  because  it  identified  and 
described  school  climates  most  conducive  to  the  teaching  and 
learning  process,  and,  in  doing  so,  it  has  provided  a body  of 
objective  research  that  supports  the  traditional  American 
belief  that  good  schools  can  and  do  enhance  student  learning 
through  the  actions  they  take  (p.  1) . 

Robinson  (1985)  stated  that  the  research  indicated  no 
single  factor  accounts  for  school  success  in  generating 
higher  levels  of  student  achievement.  The  report  concluded 
that  exemplary  pupil  performance  resulted  from  policies, 
behaviors,  and  attitudes  that  together  shaped  the  learning 
environment . 

Everson  (1981)  analyzed  a study  headed  by  Ron  Edmonds 
and  his  colleagues  at  Harvard  University  in  1973  to  define 
and  describe  school  effectiveness.  To  be  eligible  for  a 
study  the  school  had  to  teach  basic  skills  to  its  total 
population  and  had  to  have  at  least  16%  low-income  students 
in  its  total  student  population.  Edmonds  defined 
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effectiveness  as  "how  well  schools  perform  for  the  poor  in 
their  population"  (p.  42). 

After  identifying  the  schools,  Edmonds'  research  team 
looked  for  the  characteristics  that  effective  schools  had 
that  ineffective  schools  did  not  have,  by  systematically 
discarding  characteristics  that  showed  up  in  both  types  of 
schools,  so  that  only  the  differences  were  left.  The  team 
did  not  claim  these  qualities  determined  effectiveness,  but 
indicated  these  qualities  distinguished  effective  schools 
from  ineffective  ones. 

To  qualify  as  an  effective  school  in  Edmonds'  study, 
schools  had  to  demonstrate  evidence  of  all  the  following 
qualities : 

1.  Building  Leadership:  The  principal  displayed  strong 

professional  behavior;  understood  the  contribution 
of  teachers  to  the  school's  goals;  regularly 
visited/observed  classrooms;  made  useful  suggestions 
to  improve  instruction. 

2.  Instructional  Leadership:  The  adults  in  the 

building  were  consistent  in  statements  about  the 
school ' s instructional  goals  and  abided  by  these 
aims . 

3.  School  Climate:  Effective  schools  were  attractive, 

clean,  organized,  and  physically  secure  with 
adequate  instructional  space. 

4.  Implied  Teacher  Expectations:  Observers  looked  only 

at  what  teachers  did  and  not  at  what  they  thought  or 
felt.  Students  were  asked  if  they  thought  their 
teachers  expected  anyone  in  the  class  to  fall  below 
an  acceptable  level  of  achievement. 

5.  Monitoring  System:  Effective  schools  had  a system 

for  monitoring  and  assessing  public  performance  tied 
to  their  instructional  objectives.  If  achievement 
data  indicated  a need  for  change,  they  were  willing 
to  do  it.  (Everson,  1981,  p.  42) 
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Perhaps  educational  research  has  looked  in  the  wrong 
places  for  evidence  of  effectiveness.  Previous  studies  have 
indicated  that,  on  the  average,  school  policies  do  not 
greatly  affect  measurable  student  scholastic  and  occupational 
performance.  Klitgaard  and  Hall  (1973)  supported  the  notion 
that  educational  research  had,  in  fact,  looked  in  the  wrong 
places  for  evidence  of  effectiveness.  In  turn,  they  examined 
six  schools  from  Michigan  and  New  York  identified  as 
overachieving  schools.  In  conjunction,  four  additional 
states  completed  studies  of  exemplary  schools  and  included 
their  results  with  those  of  Klitgaard  and  Hall.  All  of  the 
following  factors  were  not  found  in  each  school  in  the 
studies,  but  were  characteristics  of  the  group  as  a whole: 

1.  Strong  principal  leadership  where  a school  is  run 
for  a purpose  rather  than  from  force  of  habit. 

2.  Strong  principal  participation  in  the  classroom 
instructional  program  and  in  actual  teaching. 

3 . Higher  expectations  on  the  part  of  the  principal  for 
student  and  teacher  performance  advancement. 

4.  Principals  felt  they  had  more  control  over  the 
functioning  of  the  school,  the  curriculum  and 
program,  and  their  staff. 

5.  Greater  experience  and  more  pertinent  education  in 
the  roles  of  principals,  teachers,  and  teacher 
aides . 

6.  Teachers  were  rated  as  warm,  more  responsive,  and 
showing  more  emphasis  on  cognitive  development  in 
classes  that  did  not  involve  direct  reading 
instruction  as  well  as  in  reading  classes. 

7.  Teachers  were  more  satisfied  with  opportunities  to 
try  new  things;  they  were  free  to  choose  teaching 
techniques  in  response  to  individual  pupil  needs. 

8.  More  satisfactory  parent-teacher  relationships. 
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9 . Job  responsibilities  for  the  teacher  aides  including 
working  across  all  grades  with  primarily  small,  low- 
ability  groups;  close  involvement  of  teachers  and 
paraprofessionals  with  pupils. 

10.  Schools  had  a longer  instructional  day. 

11.  In  student  evaluations,  the  teachers  relied  almost 
completely  on  teacher-developed  tests  and  teacher 
judgments  of  student  achievement. 

12.  More  positive  self-concept  and  a feeling  of 
controlling  their  own  destiny  observable  as  early  as 
grade  three  on  part  of  children.  (Austin,  1979, 

p.  ID 

A search  for  effective  schools  throughout  the  United 
States  distinguished  successful  schools  from  unsuccessful 
schools.  Many  different  activities  found  in  successful 
schools  bore  predictable  relationships  with  one  another. 
Wynne  (1981)  based  his  analysis  of  effective  schools  on  a 
19-year  study  of  140  schools  in  the  Chicago  area.  The 
following  list  describes  the  major  characteristics  associated 
with  "good  schools"  as  concluded  from  his  study: 

1.  Coherence  of  sticking  together  associated  with 
school  spirit.  In  a sense,  the  goodness  in  a good 
school  was  pervasive. 

2.  Principals  delegated  some  authority. 

3 . Principals  recruited  people  whose  qualifications 
were  known  or  chosen  with  deliberation  among  unknown 
applicants . 

4.  Staff,  students,  and  parents  developed  a clear  idea 
of  what  constitutes  good  performance  with  the 
teacher  displaying  a caring  conduct . 

5.  Administrators  and  staff  were  well-informed. 

6.  Principals  monitored  and  assessed  teachers  and  let 
teachers  know  how  they  were  doing  in  reference  to 
the  elements  of  effective  staff  performance. 

7 . Administrators  played  an  important  role  in  creating 
incentives  for  pupils  to  learn. 
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8.  Administrators  and  teachers  believed  that  classroom 
discipline  was  essential  to  learning. 

9.  Extracurricular  and  student  service  activities  were 
offered.  (pp.  377-380) 

In  less  managed  schools,  conditions  were  not  all  bad. 
Instead,  what  was  found  was  incoherence,  or  elements  of 
ineffectiveness  coupled  almost  unpredictably  with  displays  of 
efficiency  or  caring.  However,  inefficiency  persisted  like 
weeds  in  a garden.  It  seemed  hard  to  stamp  out.  This 
metaphor  can  be  carried  one  step  further.  In  an  efficient 
garden,  weeding  is  easier  once  the  plants  are  well-rooted.  A 
mature  and  vigorous  crop  chokes  out  the  weeds.  So,  too,  is 
the  case  in, highly  coherent--or  good--schools  (Wynne,  1981, 
p.  377)  . 

In  cooperation  with  researchers  at  The  Johns  Hopkins 
University,  the  newspaper.  The  Baltimore  Sun  set  out  to 
identify  and  examine  schools  that  worked  in  the  city  of 
Baltimore.  The  Johns  Hopkins  Center  for  Social  Organization 
of  Schools  developed  procedures  for  using  test  scores  to 
identify  exemplary  school  programs.  Salganik  (1980),  a 
reporter  from  The  Baltimore  Sun,  studied  schools  identified 
by  The  Johns  Hopkins  Center.  By  comparing  actual  to 
predicted  results,  it  was  possible  to  determine  whether  a 
particular  school  was  doing  better  or  worse  than  other 
schools  with  similar  neighborhoods  that  Salganik  visited 
during  more  than  2 months.  The  most  striking  differences 
between  the  "schools  that  work"  and  the  "average"  city 


schools  were  as  follows. 
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1.  Classroom  time  was  used  for  active  teaching. 

2 . Building  leaders  expected  teachers  to  teach  and 
students  to  learn  while  providing  room  for  growth 
through  problem-solving. 

3 . The  administrator  was  the  instructional  leader 
expecting  active  teaching  and  measurable  learning. 

4 . Teachers  were  used  according  to  their  talents  and 
were  allowed  to  teach  in  ways  that  work  for  them. 

5.  The  school  paid  attention  to  test  results. 

6.  Teachers  were  evaluated. 

7.  Discipline  was  handled  in  the  classroom. 

8.  There  was  quality  instruction  with  little  or  no 
seatwork. 

9.  Teachers  were  not  dictated  to  as  to  how  to  teach, 
but  were  required  to  teach  and  students  required  to 
learn.  (pp.  2-7) 

Oakes  (1989)  stated  that  for  over  a period  of  more  than 
300  years,  the  American  people  have  enlarged  their 
educational  expectations  for  schools.  Beginning 
with  narrowly  academic  and  religious  goals  in  the  17th 
century,  they  added  vocational  and  social  goals  in  the  18th 
and  19th  centuries,  and  goals  of  personal  or  self-realization 
in  the  20th  century.  Nearly  all  of  our  children  spend  8 or  9 
years  in  the  place  to  which  primary  responsibility  for 
achieving  these  goals  is  consciously  ascribed.  Most  students 
spend  from  12  to  13  years  there--some  spend  16  to  20  or  more. 
Yet,  we  are  content  to  use  various  combinations  of  the  first 
six  letters  of  the  alphabet  and  two  numbers,  sometimes 
representing  total  scores  and  percentile  rankings,  as 
virtually  the  sole  evidence  for  passing  definitive  judgment 
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on  the  adequacy  of  an  individual's  or  school's  performance 
(p.  190)  . 

Goodlad  (1979)  expressed  the  need  to  go  beyond  test 
measurements  and  student  grades  and  into  qualitative 
appraisals  of  what  goes  on  in  schools.  He  spent  several 
years  developing  instruments  to  describe  curriculum  and 
teaching  elements  to  solicit  administrators',  teachers', 
students',  and  parents'  views  on  aspects  of  schooling;  and  to 
compare  and  relate  these  data.  He  determined  the  following 
elements  to  emphasize  the  necessity  of  assembling  data  on 
schools  as  a basis  for  determining  their  present  condition 
and  beginning  a process  of  improvement. 

1.  Schools  need  to  have  a great  deal  of  autonomy  in  the 
system . 

2.  Schools  must  have  a sense  of  mission,  unity, 
identity,  and  wholeness  that  pervades  every  aspect 
of  their  functioning. 

3 . The  principal  is  central  to  the  attainment  of  the 
kind  of  school  implied. 

4.  The  surrounding  infrastructure  is  supportive-- 
principals  are  captains  of  their  ship  versus 
superintendents.  (Goodlad,  1979,  p.  346) 

The  Colorado  Department  of  Education  (CDE,  1982),  in  its 
quest  to  assist  Colorado  schools  to  improve  school  climate, 
organized  indicators  of  quality  schools  into  three  distinct, 
interrelated  dimensions.  Each  of  the  dimensions  plays  a role 
in  the  attainment  of  a quality  education  program  and  must  be 
equally  strong  to  preserve  the  quality  of  an  effective  school 
(CDE,  1982,  p.  2) . 
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The  first  dimension  identified  in  the  Colorado  study  was 

student  outcomes.  Student  outcomes  emphasize  the  primary 

mission  of  the  school--to  facilitate  positive  achievement  and 

student  satisfaction  in  learning.  Basic  to  this  premise  is 

the  need  to  identify  what  students  are  expected  to  learn  and 

whether  the  curriculum  delivers  that  learning.  The  two 

categories  of  the  CDE  instrument  that  fall  under  student 

outcomes  are  congruence  among  curricular  objectives  and 

assessment  objectives.  School  leadership  and  instruction 

accentuate  what  takes  place  in  schools  in  terms  of  the 

process  of  instruction,  administration,  and  leadership. 

The  second  dimension  was  the  accountability/accreditation, 

managing,  evaluating,  and  planning  related  to  the  school 

improvement  effort.  The  third  dimension  focused  on  the 

teaching-learning  environment  and  those  characteristics  that 

research  indicates  are  positively  related  to  student 

achievement  and  satisfaction.  The  eight  categories  within  this 

third  dimension  included  the  following: 

(a)  leadership  of  the  principal,  (b)  school  climate 
conditions  that  support  a pleasant  and  comfortable 
climate  for  students,  (c)  high  achievement  expectations 
of  all  students,  (d)  practices  and  policies, 

(e)  monitoring  and  feedback  of  student  progress, 

(f)  time  on  task--minimum  of  70%  of  the  instructional 
setting,  and  (g)  instructional  effectiveness.  (CDE, 

1982,  pp.  1-3) 

A review  of  related  literature  revealed  a majority  of 
the  early  effective  schools  studies  focused  primarily  on 
elementary  schools.  One  of  the  first  studies  to  focus  on 
secondary  schools  was  conducted  by  Rutter,  Maughan, 

Mortimore,  Ouston,  and  Smith  in  1979.  The  researchers 
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focused  on  the  education  process  in  12  secondary  inner-city, 
London  schools.  This  longitudinal  study  involved  1,500 
junior  high-school-age  students  and  assessed  each  child  on 
school  entry  variables  at  10  years  of  age  and  reassessed  them 
3 years  later.  The  researchers  controlled  for  socioeconomic 
status  and  examined  four  outcomes  including  achievement, 
attendance,  student  behavior,  and  delinquency. 

Another  study  involving  secondary  schools  was  conducted 
by  Brookover  (1981) . Secondary  teachers  were  studied  to 
determine  their  effectiveness  in  teaching  basic  computation 
and  communication  skills  in  the  sciences,  social  sciences, 
and  humanities.  Brookover  suggested  that  the  total  learning 
environment  consisted  of  three  identifiable  aspects-- 
ideology,  social  structure,  and  instructional  practices--that 
can  only  be  assessed  as  an  interdependent  system. 

Stedman  (1987)  acknowledged  that  the  set  of 
characteristics  of  effective  schools  popularized  by  Edmonds 
and  Brookover  cannot  be  substantiated.  He  believed  there  are 
two  main  reasons  why  this  is  so.  "The  first  is  that  many 
schools  that  had  the  factors  still  had  extremely  low  levels 
of  achievement,  with  students  averaging  several  years  below 
grade  level.  This  suggests  that  merely  adopting  the  formula 
[characteristics]  is  not  sufficient  to  produce  effectiveness " 
(p.  216).  The  second  reason  is  "lack  of  research  support  for 
the  formula.  This  raises  serious  questions  about  the 
programs  that  have  been  based  on  it . The  true  test  of 
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effective  schools  formula  ...  is  how  well  it  works  in 
practice"  (p.  216) . 

Mortimore  and  Sammons  (1987)  found  that  the  variations 
in  school  effectiveness  and  student  progress  and  development 
were  accounted  for  by  differences  in  school  policies  and 
practices.  The  school  and  the  classroom  provided  a 
supporting  framework  within  which  the  principal  and  teachers 
worked  to  promote  student  progress  and  development  (pp.  7-8). 
These  researchers  identified  the  following  12 
key  factors  of  effectiveness: 

1.  Purposeful  leadership  occurs  where  the  principal 
understands  the  needs  of  the  school  and  is  actively 
involved  in  the  school's  work,  without  exerting 
total  control  over  the  staff.  Student  progress  is 
monitored  throughout  the  year. 

2.  Where  assistant  principals  exist,  they  should  be 
involved  in  policy  decisions  while  understanding  the 
needs  of  the  school  and  being  actively  involved. 

3 . Teachers  are  involved  in  curriculum  planning  and 
participate  in  developing  their  own  curriculum 
guidelines . 

4.  Students  benefit  from  consistency  in  teacher 
approach  throughout  the  school . 

5.  Students  benefit  when  the  teacher  organizes  a 
framework  within  which  students  can  work,  yet  allows 
them  some  freedom  within  this  structure. 

6.  Positive  effects  occur  where  teachers  communicate 
interest  and  enthusiasm  and  use  higher-level 
questions  and  statements  that  encourage  students  to 
use  creative  imagination  and  problem-solving  skills. 

7.  The  classroom  has  a work-centered  environment. 
Teachers  spend  more  of  their  time  discussing  the 
content  of  work  and  less  time  on  routine  matters. 

8.  Teachers  teach  within  one  particular  curricular  area 
within  a session  with  the  level  of  work  geared  to 
individual  needs . 
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9.  Students  gain  from  having  frequent  communication 
with  the  teacher,  either  individual  or  with  the 
whole  class. 

10.  Teachers  keep  written  records  of  individuals'  work 
to  monitor  their  progress  and  plan  instruction. 

11.  Parental  involvement  at  home  and  in  school  fosters 
student  progress . 

12.  A positive  climate  around  the  school  and  in 
classrooms  contributes  to  children's  progress  and 
development.  (pp.  7-8) 

Mortimore  and  Sammons  (1987)  do  not  promote  the  12 
factors  as  a recipe  for  producing  an  effective  school. 
Instead,  they  propose  the  factors  provide  a framework  within 
which  the  total  school  community  can  operate  toward  student 
progress  and  development.  When  each  partner  of  the  school 
community  (principal,  staff,  parents,  and  community  members) 
"plays  a positive  role,  the  result  is  an  effective  school" 

(p.  8)  . 

Oakes  (1989)  argued  that  the  school  culture  influences 
whether  teachers  are  able  and  willing  to  provide  mind- 
stretching learning  opportunities  and  whether  students  are 
willing  to  take  advantage  of  them.  The  school  culture  helps 
determine  whether  students  and  teachers  feel  satisfied  with 
their  schools.  It  influences  whether  they  believe  that  the 
school  provides  a good  education  and  whether  students  are 
learning . 

Effective  schools  research  has  attracted  many 
researchers  to  attempt  a variety  of  studies  determining  what 
characteristics  make  some  schools  effective  and  others 
ineffective.  Some  effective  schools'  findings  summarized  a 
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variety  of  common  sense  determinants  of  school  effectiveness 
indicators  related  to  the  enhancement  of  student  learning. 

The  literature  on  effective  schools  challenges  the  assumption 
that  differences  among  schools  have  little  or  no  effect  on 
student  achievement  outcomes  and  that  outcomes  can  be 
measured  solely  on  student  achievement  scores. 

One  aspect  of  effective  schools  research  has  remained 
constant  over  time  and  it  always  considers  student 
achievement.  According  to  Doyle  (1992),  in  today's 
educational  arena,  we  find  ourselves  experiencing  a version 
of  the  "frog's  dilemma."  Drop  a frog  into  boiling  water  and 
out  it  leaps.  Plunge  a frog  into  tepid  water  and  turn  the 
heat  up  slowly,  and  the  frog,  overcome  by  languor,  will  be 
unable  to  exercise  itself  until  it  is  too  late.  Taking  a 
narrow  view  of  a problem  is  not  unique  to  education.  Being 
"as  good  as  we  have  been"  will  not  be  good  enough--not  in 
business  and  not  in  education  (p.  514). 

This  summary  of  effective  schools  research  supports  the 
existence  of  a variety  of  differing  perceptions  of  what 
effective  schools  really  are.  Goodlad  (1983)  stated  that  if 
school  improvement  continues  on  its  present  course,  our 
schools  will  remain  very  much  as  they  are.  The  gap  between 
desired  and  existing  conditions  of  education  in  schools  will 
become  greater--even  if  achievement  rises  on  measure.  We 
will  seek  to  realign  our  practices  with  more  relevant 
theories  only  if  we  are  convinced  that  fundamental 
redirection  is  necessary  (p.  470) . 


CHAPTER  3 

METHODOLOGY  OF  STUDY 
Introduction 

The  primary  purpose  of  this  study  was  to  determine 
whether  differences  exist  in  the  perceptions  of  individuals 
regarding  measures  of  school  effectiveness  at  the  middle 
school  and  high  school  levels  in  order  to  guide  policy. 
Teacher,  student,  and  parent  perceptions  of  school 
effectiveness  at  the  middle  school  level  were  compared  with 
teacher,  student,  and  parent  perceptions  of  school 
effectiveness  at  the  high  school  level.  A second  purpose  of 
the  study  was  to  assist  school  administrators  develop  a 
reporting  system  for  providing  necessary  information  to 
improve  the  effectiveness  of  the  district  schools  and  to 
provide  information  from  sources  other  than  standardized 
achievement  tests. 

This  chapter  contains  the  following  five  sections:  The 

Setting,  Population  Demographics,  Instrumentation, 
Psychometric  Properties  of  the  Questionnaires,  Data 
Collection  Procedures  and  Analysis. 

The  Setting 

The  county-wide  school  district  serves  an  urban, 
culturally  diverse  population  more  than  110,000  students  in 
grades  prekindergarten  through  postsecondary . The  area  from 
which  these  students  are  drawn  has  sizable  service,  military. 
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technical,  agricultural,  and  insurance  industries  as  its 
economic  foundation. 

The  school  district  operates  within  one  of  the  fastest 
growing  areas  in  the  nation- -a  fact  that  has  placed  much 
stress  upon  the  district  in  managing  continuous  growth  and 
declining  resources.  Residents  currently  represent  more  than 
80  different  countries,  speaking  more  than  50  languages.  The 
heavy  economic  emphasis  on  the  service  industry  has  attracted 
many  newcomers  to  the  area,  resulting  in  the  county  having  a 
younger  and  lower  wage-earning  working  population  than 
surrounding  counties.  The  school  district  is  placed  under 
great  stress  to  address  the  needs  of  children  from  families 
that  do  not  contribute  to  the  tax  base.  The  children  are 
often  transient,  below  the  poverty  level,  or  even  homeless. 

The  climate  and  the  compassion  of  local  government  officials 
for  the  needy  have  led  to  a rise  in  transients  and  homeless 
persons.  Finally,  the  amount  and  quality  of  services 
provided  to  exceptional,  vocational,  and  adult  students  have 
led  to  large  numbers  of  persons  coming  to  the  area  to  receive 
these  services. 

Population  Demographics 

The  sources  for  the  following  data  were  1992-93  school 
district  personnel  records  and  1992-93  student  enrollment 
summaries.  Study  participants  were  drawn  from  the  total 
population  of  secondary  teachers,  secondary  students,  and  the 
parents  of  secondary  students  in  regular  schools  in  grades  6- 
12.  A description  of  these  groups  follows. 
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Secondary  Teachers 

There  were  2,794  secondary  teachers  assigned  to  grades 
6-12  during  the  1992-93  school  year,  excluding  teachers  in 
exceptional  and  alternative  schools.  Of  these,  1,265  were 
middle  school  teachers  (grades  6-8)  and  1,529  were  high 
school  teachers  (grades  9-12).  The  racial/ethnic  percentages 
of  the  middle  school  teachers  were:  White  (80.63),  Black 

(14.86),  Hispanic  (4.27),  and  Other  (0.24).  Similar 
percentages  applied  to  high  school  teachers  were:  White 

(83.85) ,  Black  (12.88),  Hispanic  (3.61),  and  Other  (0.21). 
Secondary  Students 

During  1992-93,  there  were  51,364  students  in  grades 
6-12,  excluding  exceptional  and  alternative  schools.  Middle 
school  racial/ethnic  percentages  were  as  follows:  White 

(55.86) ,  Black  (26.09),  Hispanic  (14.50),  and  Other  (3.53). 

In  a similar  fashion,  percentages  for  high  school  students 
were  as  follows:  White  (55.91),  Black  (23.41),  Hispanic 

(15.81),  and  Other  (4.84). 

Parents  of  Secondary  Students 

Parental  percentages  of  the  racial/ethnic  categories 
should  be  closely  linked  to  the  percentages  of  students  in 
these  categories.  It  is  recognized  that  some  students  have 
parents  from  two  different  racial/ethnic  categories.  These 
percentages  are  not  expected  to  vary  from  the  student 
percentages  enough  to  cause  concern.  Likewise,  parental 
guardians  were  deemed  to  be  included  in  approximately  the 
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same  racial/ethnic  categorical  percentages:  White  (56), 

Black  (25),  Hispanic  (15),  and  Other  (4). 

Instrumentation 

The  instrument  used  to  gather  the  study  data  were  school 
effectiveness  questionnaires  developed  in  the  Orange  County 
(Florida)  Public  Schools  (Coney,  1990).  The  questionnaires 
were  designed  to  gather  perceptual  data  from  three  respondent 
groups:  teachers,  students  in  grades  6 through  12,  and 

parents.  Each  survey  consisted  of  a set  of  statements  on 
school  effectiveness  to  which  teachers,  students,  and  parents 
responded  using  a 5-point  Likert  scale  ranging  from  strongly 
disagree  (1.00)  to  strongly  agree  (5.00)  levels  of  agreement 
with  each  listed  statement.  A school  with  an  overall  rating 
of  3.50  or  above  was  defined  as  an  effective  school.  A 
school  with  an  overall  rating  of  2.49  or  below  was  defined 
as  an  ineffective  school.  A school  with  a score  between  2.50 
and  3.49  is  considered  neutral.  In  a similar  manner, 
effective  school  characteristics  with  an  overall  rating  of 

3.50  or  above  were  considered  to  be  effective. 

Characteristics  with  an  overall  rating  of  2.49  or  below  were 
considered  ineffective.  Characteristics  with  a score  between 

2.50  and  3.49  were  considered  neutral.  The  definitions  of 
the  characteristics  measured  by  the  questionnaires  are  as 
follows . 

1.  Instructional  Leadership:  The  school  administrators 

are  knowledgeable  and  encourage  faculty,  students  and  parents 
to  work  together  as  a team  to  make  school  programs  and 
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experiences  successful.  School  administrators  ensure  that 
high-quality  instructional  programs  and  curriculum  are 
implemented. 

2.  Clear  and  Focused  Mission:  The  mission  is 

articulated  throughout  the  school  in  a manner  that  teachers, 
parents,  and  students  clearly  understand  school  goals  and 
objectives,  policies  and  procedures,  means  of  assessment,  and 
ways  of  delivering  services. 

3.  Safe  and  Orderly  Environment:  The  school 

environment  is  favorable  for  education  experiences.  Teachers 
can  teach  and  students  can  learn  without  concerns  for  safety 
or  undue  infringements  upon  instructional  process  or  academic 
freedom. 

4.  Positive  School  Climate:  The  school  climate 

reflects  an  ambiance  of  trust,  respect,  and  caring  among 
administrators,  faculty,  students  and  parents. 

5.  High  Expectations:  All  students  are  expected  to 

learn  and  behave  responsibly.  The  school  ensures  that 
faculty,  students,  and  parents  are  aware  of  their  respective 
roles  and  responsibilities  in  student  academic  achievement. 

6.  Frequent  Assessment/Monitoring  of  Student 

Achievement : Student  academic  progress  is  measured 

frequently  by  an  assortment  of  assessment  methods . The 
results  of  these  assessments  are  used  to  improve  the  school's 
instructional  effectiveness. 

7.  Emphasis  on  Basic  Skills:  The  school  has 

challenging  standards  for  student  achievement  and  defined 
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grade-equivalent  skills  with  content  areas  and  emphasizes 
critical/higher-order  thinking  skills. 

8.  Maximum  Opportunities  for  Learning:  School 

activities  are  planned  so  that  instructional  time  is 
maximized  and  geared  to  meet  the  needs,  interests,  and 
abilities  of  all  students.  Extracurricular  and  supplemental 
activities  serve  to  support  and  enhance  the  school's 
instructional  program. 

9.  Parent /Community  Involvement:  The  school  actively 

seeks  parent  and  community  input  in  the  development  of  the 
school  mission,  policies,  and  procedures.  In  addition, 
parents  and  community  members  support  the  school  curricular 
and  extracurricular  activities  with  resources  and  services. 

10.  Strong  Professional  Development:  All  teachers  are 

improving  themselves  professionally.  Consequently,  teachers 
are  provided  with  opportunities  to  enhance  their  professional 
status  and  become  more  skilled  in  meeting  the  needs  of 
students,  parents,  community  members,  other  faculty,  and 
themselves . 

11.  Teacher  Involvement  in  Decision-Making:  Teachers 

are  a significant  component  of  the  school  team.  They  are 
involved  in  decisions  related  to  school  planning  and 
budgeting,  developing  the  school  mission  and  goals,  as  well 
as  developing  and  implementing  school  policies  and 
procedures . 

It  was  inappropriate  to  ask  parents  and  students  to 
provide  meaningful  data  on  certain  characteristic,  so  those 
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particular  items  were  eliminated  from  the  parent  and  student 
forms.  Table  1 provides  data  linking  the  number  of  items  to 
each  characteristic  for  each  questionnaire. 

As  depicted  in  Table  1,  the  developers  of  the 
questionnaires  considered  students  to  be  not  able  to  provide 
meaningful  data  on  the  school  effectiveness  characteristics 
of  instructional  leadership  and  clear  and  focused  mission 
(Coney,  1991) . Parents  and  students  were  similarly 
considered  not  to  be  able  to  competently  respond  to  school 
effectiveness  characteristics  of  strong  professional 
development  and  teacher  involvement  in  decision  making. 
Consequently,  comparisons  cannot  be  made  between  teachers  and 
students  relative  to  the  school  effectiveness  characteristics 
of  instructional  leadership  and  clear  and  focused  mission. 
Additionally,  comparisons  can  not  be  made  between  teachers 
and  either  parents  or  students  regarding  the  school 
effectiveness  characteristics  of  strong  professional 
development  and  teacher  involvement  in  decision  making. 

The  teacher  questionnaire  contains  67  indicators  that 
address  11  school  effectiveness  characteristics,  the  parent 
questionnaire  contains  42  indicators  that  address  nine  school 
effectiveness  characteristics,  and  the  student  questionnaire 
contains  33  indicators  that  address  seven  school 
effectiveness  characteristics.  All  questionnaires  were 
responded  to  using  a National  Computer  Systems  (NCS)  General 
Purpose  Answer  Sheet  and  were  electronically  scanned.  The 
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results  were  analyzed  with  the  SAS  system,  a statistical 
software  package  for  the  social  sciences. 

Table  1 

Relationship  of  School  Effectiveness  Characteristics  to 
Indicators  bv  Questionnaire  Type 


Item  Numbers 

on  Questionnaire 

Effective  School  Characteristics 

Teacher 

Parent 

Student 

1. 

Instructional  Leadership 

1-8 

1-6 

★ 

2 . 

Clear  and  Focused  Mission 

9-15 

7-10 

★ 

3 . 

Safe  and  Orderly  Environment 

16-20 

11-15 

1-8 

4 . 

Positive  School  Climate 

21-27 

16-21 

9-15 

5 . 

High  Expectations 

28-32 

22-24 

16-18 

6. 

Frequent  Assessment  Monitoring 
of  Student  Achievement 

33-38 

25-28 

19-22 

7 . 

Emphasis  on  Basic  Skills 

39-43 

29-30 

23-25 

8 . 

Maximum  Opportunities  for 
Learning 

44-49 

31-35 

26-31 

9 . 

Parent  Community  Involvement 

50-55 

36-42 

32-33 

10  . 

Strong  Professional  Development 

56-62 

★ 

★ 

11. 

Teacher  Involvement  in  Decision 
Making 

63-67 

* 

* 

* Represents  unmeasured  characteristics  on  the  questionnaire. 


Psychometric  Properties  of  the  Questionnaires 
In  a paper  presented  at  the  1991  annual  meeting  of  the 
American  Educational  Research  Association  in  Chicago, 
Illinois,  Dr.  Freeman  Coney,  III  (Coney,  1991)  provided  the 
following  information  about  the  questionnaires  used  in  this 


study . 
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Teacher  Questionnaire 

The  67-item  instrument  was  pilot-tested  on  770  teachers 
and  found  to  have  a Cronbach's  Alpha  coefficient  of  .984. 

This  coefficient  is  the  mean  of  all  possible  split- 
half  reliabilities  and  is  generally  considered  the  best 
indicator  of  the  reliability  of  a questionnaire.  After 
undergoing  strenuous  testing,  each  characteristic  was  found 
to  consist  of  one  factor  only.  Reliability  coefficients  for 
the  characteristics  were  found  to  be  at  least  .81. 

Student  Questionnaire 

The  33-item  instrument  was  pilot-tested  on  5,683 
students  and  found  to  have  a Cronbach's  Alpha  coefficient  of 
.947.  Each  characteristic  contained  one  factor  only,  and 
characteristic  reliabilities  were  at  least  .84. 

Parent  Questionnaire 

The  42-item  instrument  was  pilot-tested  on  3,427  parents 
and  found  to  have  a Cronbach's  Alpha  coefficient  of  .973.  As 
with  the  teacher  instrument,  each  characteristic  was  found  to 
have  one  factor  only,  and  characteristic  reliabilities  were 
at  least  .71. 

Interviews  with  the  author  resulted  in  an  affirmation  of 
these  properties.  The  analysis  provided  construct  validity 
for  each  instrument  along  with  content  validity  already 
established  during  the  committee  process  of  development.  A 
replication  study  of  these  questionnaires  in  another  Florida 
school  district  produced  similar  results. 
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Data  Collection  Procedures  and  Analysis 
The  data  collected  for  this  study  were  district-wide 
data  from  the  1992-93  school  year  from  school  effectiveness 
surveys  administered  in  middle  schools  and  high  schools. 

The  questionnaires  are  routinely  made  available  to  all 
schools  in  the  district  as  part  of  the  school  improvement 
process.  The  researcher  has  no  control  over  the  number  of 
participating  schools,  but  historical  data  indicate  that 
large  majorities  of  middle  and  high  school  principals  select 
the  questionnaires  for  use  each  year. 

The  use  of  the  questionnaires  was  voluntary.  Therefore, 
the  participants  in  the  study  were  nonrandom.  The  expected 
large  sample  sizes,  along  with  the  lack  of  researcher  bias 
in  the  selection  process,  led  to  usable  data  from  which 
conclusions  could  be  drawn. 

A statistical  software  package  produced  by  the  SAS 
Institute,  Inc.  was  used  to  analyze  many  of  the  data.  The 
researcher  collected  and  recorded  the  responses  to  the 
school  effectiveness  surveys  using  SAS  release  6.07.  For 
specific  areas  of  school  improvement,  three  research 
questions  were  developed.  The  research  questions 
determined  if  differences  exist  in  perceptions  of  school 
effectiveness  of  teachers,  students,  and  parents  between 
middle  schools  and  high  schools  in  a large  urban  school 
district.  The  first  question,  "Are  there  significant 
differences  in  perceptions  between  middle  and  high  school 
teachers  on  each  of  the  characteristics  of  school 
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effectiveness?,"  was  analyzed  using  an  independent  Student-t 
statistics  test.  The  second  question,  "Are  there 
significant  differences  in  perceptions  between  middle  and 
high  school  students  on  each  of  the  characteristics  of  school 
effectiveness?, " was  analyzed  using  an  independent  Student-t 
statistics  test.  The  third  question,  "Are  there  significant 
differences  in  perceptions  between  middle  and  high  school 
parents  on  each  of  the  characteristics  of  school 
effectiveness?,"  was  analyzed  using  an  independent  Student-t 
statistics  test.  Probabilities  of  less  than  or  equal  to  .05 
were  considered  to  be  indicative  of  significant  differences 
between  the  means  of  school  effectiveness  characteristics 
being  compared.  Means  of  school  effectiveness 
characteristics  for  teacher,  student,  and  parent  samples  at 
the  middle  school  level  were  compared  with  similar  data  at 
the  high  school  level.  Appropriate  posthoc  and  additional 
testings  were  performed. 

Summary 

The  researcher  sought  to  determine  whether  differences 
existed  in  the  perceptions  of  individuals  regarding  measures 
of  school  effectiveness  at  the  middle  school  and  high  school 
levels.  The  five-point  Likert  scale  was  used  to  compare 
teacher,  student,  and  parent  perceptions  of  school 
effectiveness  at  the  middle  school  level  with  teacher, 
student,  and  parent  perceptions  of  school  effectiveness  at 
the  high  school  level.  Chapter  4 presents  the  data  from 
school  effectiveness  survey  questionnaires. 


CHAPTER  4 

ANALYSIS  OF  THE  DATA 


The  purpose  of  this  chapter  is  to  display  the  survey 
results,  show  the  results  of  statistical  analysis  of  the 
data,  and  identify  issues  for  further  discussion.  Study 
participants  provided  data  via  the  teacher,  student,  and 
parent  versions  of  the  three  school  effectiveness  surveys 
used  in  a large  Florida  school  district.  The  researcher 
functioned  independently  of  the  participant  selection 
process.  Potential  participants  were  identified  by 
principals  and  school  advisory  committees . Actual 
participants  were  self -selected,  for  each  respondent  group 
had  the  choice  of  whether  or  not  to  complete  the  instrument. 

For  these  reasons,  the  researcher  considers  the  data  to 
be  uncontaminated  by  external  influences  associated  with  the 
researcher.  This  is  the  nature  of  most  post  hoc  data 
analyses . 

Survey  Data 

Usable  survey  data  were  received  from  680  teachers  (385 
middle  school  and  295  high  school),  4,608  students  (3,237 
middle  school  and  1,371  high  school),  and  1,626  parents 
(1,074  middle  school  and  552  high  school).  Table  2 lists  the 
number  of  respondents  by  school  level  and  survey  type . 
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Table  2 

Number  of  Survey  Respondents  by  School  Level  and  Survey  Type 
(N  = 6.914) 


Tyoe  of  Survev 

Middle 

School  Level 
Hiah 

Total 

Teacher 

385 

295 

680 

Student 

3,237 

1,371 

4,608 

Parent 

Total 

1,074 

552 

1,626 

6,914 

Means  and  standard  deviations  were  computed  for 
characteristics  of  school  effectiveness  by  school  level. 
Tables  3 through  14  provide  the  results  of  the  three  surveys. 

Examination  of  the  means  and  standard  deviations  in 
Table  3 leads  to  the  following  conclusions. 

1.  All  middle  school  teacher  means  are  above  the  range 
midpoint  of  3.00  indicating  that  the  respondents  were  more 
likely  to  have  positive  perceptions  of  the  characteristics 
than  not.  Teacher  involvement  in  decision  making 
(characteristic  11)  received  the  lowest  rating  (3.10)  and  had 
the  greatest  standard  deviation  (1.03). 

2.  Small  range  differences  among  standard  deviations 
are  an  indication  of  similarity  in  the  shape  of  the 
distributions  of  the  variables.  The  maximum  difference  in 
the  teacher  standard  deviations  of  .2  (1.03  - .83)  indicates 
that  the  item  variances  are  similar. 
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Table  3 

Middle  School  Teacher  School  Effectiveness  Characteristics 
Means  and  Standard  Deviations  (N  = 385) 


Characteristic 

Mean 

STD 

1. 

Instructional  Leadership 

3 . 46 

.98 

2. 

Clear  and  Focused  Mission 

3 . 65 

.88 

3 . 

Safe  and  Orderly  Environment 

3.39 

.91 

4. 

Positive  School  Climate 

3.43 

.87 

5. 

High  Expectations 

3 . 44 

.99 

6. 

Frequent  Assessment/Monitoring 
of  Student  Achievement 

3 . 82 

.86 

7 . 

Emphasis  on  Basic  Skills 

3 . 69 

.92 

8. 

Maximum  Opportunities  for  Learning 

3 . 49 

.88 

9 . 

Parent /Community  Involvement 

3.53 

.83 

10. 

Strong  Professional  Development 

3 . 52 

.95 

11. 

Teacher  Involvement  in  Decision-Making 

3.10 

1.03 

STD 

= Standard  Deviation 

Examination  of  the  means  and  standard 

deviations 

in 

Table  4 leads  to  the  following  conclusions: 

1.  Student  means  were  varied  (range  of  means  = 1.34), 
as  were  the  standard  deviations.  The  range  of  difference  for 
the  characteristics  was  .39. 

2.  Student  means  that  fell  below  the  midpoint  included 
perceptions  of  positive  school  climate  (2.76)  and  maximum 
opportunities  for  learning  (2.94). 

3 . The  highest  student  means  appeared  in  high 


expectations  (4.10). 
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Table  4 

Middle  School  Student  School  Effectiveness  Characteristics 
Means  and  Standard  Deviations  (N  = 3.237) 


Characteristic 

Mean 

STD 

1. 

Safe  and  Orderly  Environment 

3 . 42 

.76 

2 . 

Positive  School  Climate 

2.76 

.88 

3 . 

High  Expectations 

4 . 10 

.94 

4. 

Frequent  Assessment  Monitoring 
of  Student  Achievement 

3 . 57 

.94 

5. 

Emphasis  on  Basic  Skills 

3 . 96 

.90 

6. 

Maximum  Opportunities  for  Learning 

2 . 94 

.86 

7 . 

Parent /Community  Involvement 

3.01 

1.15 

STD  = Standard  Deviation 


Examination  of  the  means  and  standard  deviations  in 
Table  5 leads  to  the  following  conclusions: 

1.  All  parent  means  are  above  the  range  midpoint  of 
3.00,  indicating  that  the  respondents  were  more  likely  to 
have  positive  perceptions  of  the  characteristics  than  not. 

2 . The  highest  mean  appeared  on  the  characteristic  of 
emphasis  on  basic  skills  (4.01). 

3.  The  maximum  difference  in  the  parent  standard 
deviations  of  .13  (.96  - .83)  indicates  that  the  item 


variances  are  similar. 
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Table  5 

Middle  School  Parent  School  Effectiveness  Characteristics 
Means  and  Standard  Deviations  (N  = 1,074) 


Characteristic 

Mean 

STD 

1. 

Instructional  Leadership 

3 . 57 

.83 

2. 

Clear  and  Focused  Mission 

3 . 84 

.86 

3 . 

Safe  and  Orderly  Environment 

3.79 

.86 

4. 

Positive  School  Climate 

3 . 66 

.86 

5. 

High  Expectations 

3.84 

.92 

6. 

Frequent  Assessment/Monitoring 
of  Student  Achievement 

3 . 82 

.96 

7 . 

Emphasis  on  Basic  Skills 

4 . 01 

.93 

8. 

Maximum  Opportunities  for  Learning 

3 . 48 

.82 

9. 

Parent /Community  Involvement 

3 . 47 

.84 

STD 

= Standard  Deviation 

Examination  of  the  means  and  standard 

deviations 

in 

Table  6 leads  to  the  following  conclusions: 

1.  High  school  teacher  means  were  above  the  range 
midpoint  of  3.00,  meaning  that  their  perceptions  of  the 
characteristics  were  more  likely  to  be  positive  than  not. 

2.  The  small  range  difference  between  standard 
deviations  indicates  similar  distributions  for  each  of  the 
characteristics.  The  means  varied  by  characteristics  from 
3.14  to  3.79,  but  the  standard  deviations  were  less  varied-- 
from  .80  to  1.00  (.20). 

3 . Teachers  involved  in  decision  making  received  the 
lowest  mean  (3.14)  and  the  highest  standard  deviation  (1.00). 


48 


Table  6 

High  School  Teacher  School  Effectiveness  Characteristics 
Means  and  Standard  Deviations  (N  = 295) 


Characteristic 

Mean 

STD 

1. 

Instructional  Leadership 

3 . 62 

.96 

2 . 

Clear  and  Focused  Mission 

3.77 

.81 

3 . 

Safe  and  Orderly  Environment 

3.29 

.84 

4. 

Positive  School  Climate 

3.33 

.80 

5. 

High  Expectations 

3.47 

.89 

6. 

Frequent  Assessment/Monitoring  of 
Student  Achievement 

3.79 

.82 

7 . 

Emphasis  on  Basic  Skills 

3.71 

.84 

8. 

Maximum  Opportunities  for  Learning 

3 . 49 

.86 

9 . 

Parent -Community  Involvement 

3.36 

.81 

10. 

Strong  Professional  Development 

3.75 

.92 

11. 

Teacher  Involvement  in  Decision  Making 

3 . 14 

1.00 

STD  = Standard  Deviation 


Examination  of  the  means  and  standard  deviations  in 
Table  7 leads  to  the  following  conclusions: 

1.  High  school  student  means  fell  below  the  midpoint  of 
3.00  on  the  characteristics  of  positive  school  climate  (2.82) 
and  parent  community  involvement  (2.78). 

2.  The  relatively  large  range  difference  of  the 
standard  deviations  is  .42  indicating  more  variation  among 
this  sample  of  respondents. 
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Table  7 

High  School  Student  School  Effectiveness  Characteristics 
Means  and  Standard  Deviations  (N  = 1,371) 


Characteristic 

Mean 

STD 

1. 

Safe  and  Orderly  Environment 

3.35 

.74 

2. 

Positive  School  Climate 

2.82 

.78 

3 . 

High  Expectations 

3 . 88 

.92 

4 . 

Frequent  Assessment/Monitoring 
of  Student  Assessment 

3 . 41 

.86 

5. 

Emphasis  on  Basic  Skills 

3 . 90 

.85 

6. 

Maximum  Opportunities  for  Learning 

3.05 

.73 

7 . 

Parent  Community  Involvement 

2.78 

1.16 

STD  = Standard  Deviation 


Examination  of  the  means  and  standard  deviations  in 
Table  8 leads  to  the  following  conclusions: 

1.  High  school  parent  means  were  above  the  midpoint  of 
3.00,  indicating  that  their  perceptions  of  the 
characteristics  were  more  likely  to  be  positive  than  not. 

2.  The  relatively  small  range  difference  of  .18  for  the 
standard  deviations  of  the  characteristics  indicates  similar 
distributions  for  each  characteristic  even  though  the  means 
varied. 

3 . The  highest  mean  appeared  on  emphasis  on  basic 


skills  (4.00) . 


50 


Table  8 

High  School  Parent  School  Effectiveness  Characteristics  Means 
and  Standard  Deviations  (N  = 552) 


Mean 


STD 


1. 

Instructional  Leadership 

3 . 49 

.79 

2. 

Clear  and  Focused  Mission 

3 . 69 

.81 

3. 

Safe  and  Orderly  Environment 

3.58 

.82 

4. 

Positive  School  Climate 

3.40 

.87 

5. 

High  Expectations 

3 . 68 

.91 

6. 

Frequent  Assessment/Monitoring  of 
Student  Achievement 

3 . 69 

.96 

7 . 

Emphasis  on  Basic  Skills 

4.00 

.97 

8. 

Maximum  Opportunities  for  Learning 

3.39 

.79 

9 . 

Parent /Community  Involvement 

3.25 

.82 

STD  = Standard  Deviation 


Examination  of  the  means  and  standard  deviations  in 
Table  9 leads  to  the  following  conclusions: 

1.  Middle  and  high  school  teacher  means  are  above  the 
midpoint  of  3.00,  indicating  respondents  were  more  likely  to 
have  positive  perceptions  of  characteristics  than  not. 

2.  The  small  range  differences  among  standard 
deviations  are  indication  of  similarity  in  the  shape  of  the 
distributions  of  the  variable. 

3 . Teacher  involvement  in  decision  making  received  the 
lowest  rating  and  the  highest  standard  deviation  for  both 


teacher  groups. 
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Table  9 

Comparison  of  the  Means  of  School  Effectiveness 
Characteristics  Between  Middle  and  High  School  Teachers 


MST 

HST 

(N  = 

285) 

(N  = 

295) 

Characteristic 

Mean 

STD 

Mean 

STD 

1. 

Instructional  Leadership 

3.46 

.98 

3 . 62 

.96 

2 . 

Clear  and  Focused  Mission 

3.65 

.88 

3.77 

.81 

3. 

Safe  and  Orderly  Environment 

3.39 

.91 

3.29 

. 84 

4. 

Positive  School  Climate 

3.43 

.87 

3.33 

. 80 

5. 

High  Expectations 

3.44 

.99 

3.47 

.89 

6. 

Frequent  Assessment/Monitoring 
of  Student  Achievement 

3.82 

.86 

3.79 

.82 

7 . 

Emphasis  on  Basic  Skills 

3.69 

.92 

3.71 

. 84 

8. 

Maximum  Opportunities  for 
Learning 

3.49 

.88 

3 . 49 

.86 

9. 

Parent /Community  Involvement 

3.53 

.83 

3.36 

.81 

10. 

Strong  Professional  Development 

3.52 

.95 

3.75 

. 92 

11. 

Teacher  Involvement  in 
Decision  Making 

3.10 

1.03 

3 . 14 

1.00 

STD  = Standard  Deviation 
MST  = Middle  School  Teachers 
HST  = High  School  Teachers 


Examination  of  the  means  and  standard  deviations  in 
Table  10  leads  to  the  following  conclusions: 

1.  Middle  school  and  high  school  student  means  fell 
below  the  means  of  3.00  on  the  characteristic  of  positive 
school  climate. 

2 . The  range  of  standard  deviations  varied  widely  for 
both  groups  of  students  (middle  = .39;  high  = .42),  but  the 
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standard  deviations  were  similar  between  groups  for 
characteristics  1,  3,  4,  and  7. 

3 . Student  means  were  highest  for  the  characteristics 
of  high  expectations  and  emphasis  on  basic  skills. 

Table  10 

Comparison  of  the  Means  of  School  Effectiveness 
Characteristics  Between  Middle  and  High  School  Students 


Characteristic 

MSS 

(N  = 3,237) 
Mean  STD 

HSS 

(N  = 1,371) 
Mean  STD 

1. 

Safe  and  Orderly  Environment 

3.42 

.76 

3.35 

.74 

2. 

Positive  School  Climate 

2.76 

.98 

2.82 

.78 

3 . 

High  Expectations 

4.10 

.94 

3 . 88 

. 92 

4. 

Frequent  Assessment/Monitoring 
of  Student  Achievement 

3.57 

.94 

3 . 88 

.92 

5. 

Emphasis  on  Basic  Skills 

3.96 

.90 

3 . 90 

.85 

6. 

Maximum  Opportunities  for 
Learning 

2.94 

.86 

3 . 05 

.73 

7 . 

Parent /Community  Involvement 

3.01  1 

.15 

2.78  : 

L.  16 

STD 

MSS 

HSS 

= Standard  Deviation 
= Middle  School  Students 
= High  School  Students 

Examination  of  the  means  and 

standard 

deviations  in 

Table  11  leads  to  the  following  conclusions: 

1.  The  characteristic  of  emphasis  on  basic  skills 
received  the  highest  means  from  both  groups  of  parents. 

2.  Both  groups  of  parent  means  were  above  the  mean  of 
3.00,  indicating  that  their  perceptions  of  the 
characteristics  were  more  likely  to  be  positive  than  not. 
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3 . The  standard  deviations  of  high  school  parents  were 
more  varied  (.18)  than  that  of  middle  school  parents  (.10), 
although  there  was  a small  range  of  difference  between  the 
standard  deviations  of  both  groups.  This  indicates  similar 
distributions  for  each  characteristic. 

Table  11 

Comparison  of  the  Means  of  School  Effectiveness 
Characteristics  Between  Middle  and  High  School  Parents 


MSP 

(N  = 1,074) 

HSP 

(N  = 552 

) 

Characteristic 

Mean 

STD 

Mean  STD 

1. 

Instructional  Leadership 

3.57 

.83 

3.49  . 

79 

2 . 

Clear  and  Focused  Mission 

3.84 

.86 

3.69  . 

81 

3 . 

Safe  and  Orderly  Environment 

3.79 

.86 

3.58  . 

82 

4. 

Positive  School  Climate 

3 . 66 

.86 

3.58  . 

82 

5. 

High  Expectations 

3.84 

.92 

3.68  . 

91 

6. 

Frequent  Assessment /Monitoring 
of  Student  Achievement 

3.82 

.93 

3.69  . 

96 

7 . 

Emphasis  on  Basic  Skills 

4.01 

.93 

4.00  . 

97 

8. 

Maximum  Opportunities  for 
Learning 

3.48 

.82 

3.39  . 

79 

9 . 

Parent/Community  Involvement 

3 . 47 

.84 

3.25  . 

82 

STD  = Standard  Deviation 
MSP  = Middle  School  Parents 
HSP  = High  School  Parents 

t-Test  Analysis 

The  data  are  derived  from  two  mutually  exclusive  levels: 
middle  school  and  high  school.  The  appropriate  analysis  is 
the  t-test  for  independent  samples.  The  computer  software 
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procedure  used  to  analyze  the  data  was  based  on  information 
found  on  pages  1634-36  of  SAS/STAT  Users  Guide  Volume  2,  GLM- 
VARCOMP,  Version  6,  Fourth  Edition. 

This  statistical  procedure  measures  the  probability  of 
two  population  means  being  the  same  and  adjusts  for  equal  and 
unequal  variances.  When  the  probability  is  equal  to  or  less 
than  .05,  the  difference  between  the  means  is  considered  to 
be  significant.  The  lower  the  probability,  the  greater  the 
level  of  significance. 

Teacher  Survey 

Statistical  differences  between  middle  and  high  school 
teachers  were  found  on  three  teacher  characteristics  of 
school  effectiveness:  instructional  leadership, 

parent /community  involvement,  and  strong  professional 
development.  Relevant  statistical  data  are  provided  in 
Table  12 . 

High  school  teachers  in  the  sample  rated  instructional 
leadership  and  strong  professional  development  significantly 
higher  than  did  middle  school  teachers.  The  very  low 
probability  (.001)  of  the  sample  means  for  the  strong 
professional  development  variable  suggests  a more  positive 
perception  was  held  of  professional  development  efforts  at 
the  high  school  level  than  at  the  middle  school  level.  Less 
strong,  but  similar,  conclusions  can  be  made  regarding 
instructional  leadership. 

For  the  parent /community  involvement  variable,  middle 
school  teachers  had  significantly  more  highly  positive 


perceptions  than  high  school  teachers.  The  probability  of 
the  means  of  middle  and  high  school  teachers  being  the  same 
was  a very  low  .007. 
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Table  12 


Teacher  t-Test 

Procedure  Results 

Yieldincr  Sicrnificant 

Differences 

Variable 

School  Level  N 

Mean 

STD 

Error 

DF 

Prob<t 

1.  Instructional 

Middle 

385 

3.46 

.98 

.05 

639 

.032 

Leadership 

High 

295 

3 . 62 

.96 

.06 

2.  Parent /Community  Middle 

385 

3 .53 

.83 

.04 

637 

.007* 

Involvement 

High 

295 

3.36 

.81 

.05 

3 . Strong  Professional  Middle 

385 

3.52 

.95 

. 05 

638 

.001* 

Development 

High 

295 

3.75 

.92 

. 05 

* = Very  Significant 

N = Number  in  Sample 

STD  = Standard  Deviation 

DF  = Degrees  of  Freedom 

Probct  = Probability  of  less  than  t 


Student  Survey 

Statistical  differences  between  middle  and  high  school 
students  were  found  for  all  seven  measured  school 
effectiveness  characteristics.  The  statistical  data  are 
displayed  in  Table  13.  The  student  t-test  procedure  reveals 
data  that  led  to  the  following  observations. 


1.  Probabilities  of  the  means  for  middle  and  high 
school  student  samples  being  identical  were  less  than  .01  for 
four  school  effectiveness  variables,  and  between  .01  and  .05 


for  the  other  three  variables. 
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Table  13 

Student  t-Test  Procedure  Results  Yielding  Significant 
Differences 


Variable  School  Level  N 

Mean 

STD 

Error 

DF 

Probct 

1. 

Safe  and  Orderly 

Middle 

3,237 

3.42 

.76 

.01 

2,640 

.033 

Environment 

High 

1,371 

3.35 

.74 

.02 

2 . 

Positive  School 

Middle 

3,237 

2.76 

.88 

.02 

2,877 

.024 

Environment 

High 

1,137 

2.82 

.78 

.02 

3 . 

High  Expectations 

Middle 

3,237 

4 . 10 

.94 

.02 

2,624 

.000* 

High 

1,137 

3.88 

.92 

.02 

4. 

Frequent  Assessment/ 

Middle 

3,237 

3.57 

.94 

.02 

2,624 

.000* 

Monitoring  of 

High 

1,137 

3.41 

.86 

.02 

Student  Achievement 

5. 

Emphasis  on 

Middle 

3,237 

3.96 

.90 

. 02 

2,708 

.045 

Basic  Skills 

High 

1,137 

3.90 

.85 

.02 

6. 

Maximum  Opportunities 

Middle 

3,237 

2.94 

.86 

.02 

3,023 

.000* 

for  Learning 

High 

1,137 

3.05 

.72 

.02 

7 . 

Parent /Community 

Middle 

3,237 

3.01 

1 . 15 

.02 

2,569 

.000* 

I n vo 1 veme n t 

High 

1,137 

2.78 

1 . 16 

.03 

* = Very  Significant 

N = Number  in  Sample 

STD  = Standard  Deviation 

DF  = Degrees  of  Freedom 

Probct  = Probability  of  less  than  t 

2.  Student  perceptions  varied  across  the  school 
effectiveness  variables  in  that  some  means  were  higher  at  the 
middle  school  level  and  others  were  higher  at  the  high  school 
level.  When  compared  to  middle  school  students,  high  school 
students  rated  positive  school  climate,  and  maximum 
opportunities  for  learning  higher  than  did  middle  school 
students.  The  opposite  was  true  for  the  characteristics  safe 
and  orderly  high  expectations,  frequent  assessment/monitoring 
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of  student  achievement,  emphasis  on  basic  skills,  and 
parent /community  involvement. 

Parent  Survey 

The  t-test  results  between  middle  and  high  school 
parents  in  the  sample  indicate  statistical  differences  were 
present  for  seven  of  nine  characteristics  of  school 
effectiveness.  Table  14  presents  the  statistical  data 
relating  to  the  variables  with  significant  differences.  The 
variables  instructional  leadership  and  emphasis  on  basic 
skills  were  found  to  be  statistically  equivalent. 

Table  14  data  indicate  the  following:  Middle  school 

parents  rated  seven  school  effectiveness  characteristics 
significantly  higher  than  high  school  parents.  The  school 
effectiveness  variables  were  as  follows:  instructional 

leadership,  clear  and  focused  mission,  safe  and  orderly 
environment,  positive  school  climate,  high  expectations, 
frequent  assessment/monitoring  of  student  achievement, 
maximum  opportunities  for  learning,  and  parent /community 
involvement,  and  emphasis  on  basic  skills. 

The  probabilities  of  the  sample  means  being  identical 
were  very  low  (less  than  .01)  for  four  variables.  Two 
probabilities  were  at  .011,  and  the  other  was  at  .031. 

Summary 

The  data  provide  answers  to  the  following  thre  research 
questions  in  this  manner. 
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Table  14 

Parent  t-Test  Procedure  Results  Yielding  Significant 
Differences 


Variable  School  Level  N 

Mean 

STD 

Error 

DF 

Probct 

1. 

Clear  and  Focused 

Middle 

1,  074 

3.84 

.86 

.03 

1,175 

.001* 

Mission 

High 

551 

3 . 68 

.81 

.03 

2 . 

Safe  and  Orderly 

Middle 

1,  074 

3.79 

.86 

.03 

1, 152 

.011* 

Environment 

High 

551 

3.58 

.82 

. 04 

3 . 

Positive  School 

Middle 

1,  074 

3.66 

.86 

. 03 

1,098 

.000* 

Climate 

High 

551 

3.40 

.87 

.04 

4 . 

High  Expectations 

Middle 

1,  074 

3 .84 

.92 

. 03 

1,121 

.001* 

High 

551 

3.41 

.86 

. 02 

5. 

Frequent  Assessment/ 

Middle 

1,074 

3.82 

.96 

. 03 

1,  114 

.011* 

Monitoring  of 

High 

551 

3.70 

.96 

. 04 

Student  Achievement 

6. 

Maximum  Opportunities 

Middle 

1,  074 

3 .48 

.82 

. 03 

1,151 

.031 

for  Learning 

High 

551 

3.05 

.72 

.02 

7 . 

Parent /Community 

Middle 

1,  074 

3.47 

.84 

. 03 

1, 132 

.000* 

Involvement 

High 

551 

3.25 

.82 

. 03 

* = Very  Significant 

N = Number  in  Sample 

STD  = Standard  Deviation 

DF  = Degrees  of  Freedom 

Prob<t  = Probability  of  less  than  t 

1.  Are  there  significant  differences  in  perceptions 
between  middle  and  high  school  teachers  on  each  of  the 
following  characteristics  of  school  effectiveness? 

(a)  Instructional  leadership 

(b)  Clear  and  focused  mission 

(c)  Safe  and  orderly  environment 

(d)  Positive  school  climate 

(e)  High  expectations 
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(f)  Frequent  assessment /monitoring  of  student 
achievement 

(g)  Emphasis  on  basic  skills 

(h)  Maximum  opportunities  for  learning 

(i)  Parent /community  involvement 

(j)  Strong  professional  development 

(k)  Teacher  involvement  in  decision  making 

The  answer  is  yes  for  characteristics  a,  i,  and  j. 
Significantly  higher  means  were  found  for  high  school 
teachers  than  for  middle  school  teachers  on  characteristics  a 
and  j.  The  opposite  was  found  for  characteristic  i.  No 
significant  differences  were  found  for  the  other 
characteristics . 

2.  Are  there  significant  differences  in  perceptions 
between  middle  and  high  school  students  on  each  of  the 
following  characteristics  of  school  effectiveness? 

(a)  Safe  and  orderly  environment 

(b)  Positive  school  climate 

(c)  High  expectations 

(d)  Frequent  assessment/monitoring  of  student 
achievement 

(e)  Emphasis  on  basic  skills 

(f)  Maximum  opportunities  for  learning 

(g)  Parent/community  involvement 

The  answer  is  yes  for  characteristics  a through  g. 
Significant  differences  were  found  for  all  variables.  Means 
were  significantly  higher  among  high  school  students  for  the 
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following  variables:  positive  school  climate,  and  maximum 

opportunities  for  learning.  Means  were  lower  among  high 
school  students  for  these  variables:  safe  and  orderly 

environment,  high  expectations,  frequent 

assessment /monitoring  of  student  achievement,  emphasis  on 
basic  skills,  and  parent /community  involvement. 

3.  Are  there  significant  differences  in  perceptions 
between  middle  and  high  school  parents  on  each  of  the 
following  characteristics  of  school  effectiveness? 

(a)  Instructional  leadership 

(b)  Clear  and  focused  mission 

(c)  Safe  and  orderly  environment 

(d)  Positive  school  climate 

(e)  High  expectations 

(f)  Frequent  assessment /monitoring  of  student 
achievement 

(g)  Emphasis  on  basic  skills 

(h)  Maximum  opportunities  for  learning 

(i)  Parent /community  involvement 

The  answer  is  yes  for  characteristics  b through  f,  h, 
and  i.  Significantly  higher  means  were  found  for  parents  of 
high  school  students  on  these  variables.  No  significant 
differences  were  found  for  the  other  variables. 

The  significant  differences  in  the  perceptions  of 
between  middle  and  high  school  teachers,  students,  and 
parents  for  some  of  the  characteristics  require  further 
discussion.  The  statistical  differences,  the  conditions  that 
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could  have  led  to  the  differences,  and  the  school  improvement 
activities  that  could  improve  each  situation  are  discussed  in 
the  Chapter  5 . 


CHAPTER  5 

SUMMARY,  CONCLUSIONS,  AND  RECOMMENDATIONS 

This  chapter  includes  a summary  of  the  study, 
conclusions  drawn  by  the  researcher,  and  recommendations  for 
further  research.  The  primary  purpose  of  the  study  was  to 
determine  whether  differences  exist  in  the  perceptions  of 
individuals  regarding  measures  of  school  effectiveness  at  the 
middle  and  high  school  level.  Teacher,  student,  and  parent 
perceptions  of  school  effectiveness  at  the  middle  school 
level  were  compared  with  teacher,  student,  and  parent 
perceptions  of  school  effectiveness  at  the  high  school  level. 
A second  purpose  of  the  study  was  to  assist  school 
administrators  to  develop  a reporting  system  for  providing 
necessary  information  to  improve  the  effectiveness  of 
district  schools  and  to  provide  information  from  sources 
other  than  standardized  achievement  tests. 

Significant  differences  were  found  between  middle  and 
high  school  respondents  for  some  school  effectiveness 
characteristics  on  each  of  the  surveys.  These  differences 
and  possible  factors  contributing  to  these  differences  will 
be  discussed  in  this  chapter. 

Summary  of  the  Study 

For  several  decades,  the  dominant  measure  of  school 
educational  effectiveness  has  been  the  standardized  test. 

The  early  measurements  of  school  effectiveness  originally 
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focused  on  using  standardized  achievement  tests  alone. 
Unfortunately,  this  singular  form  of  research  overlooked  a 
variety  of  factors  (i.e.,  characteristics)  that  constitute 
effectiveness.  The  school  effectiveness  survey 
questionnaires  were  created  to  provide  a quantitative  measure 
of  the  opinions  and  attitudes  of  teachers,  students,  and 
parents  relative  to  characteristics  of  school  effectiveness. 

A highly  reliable  school  effectiveness  survey  instrument 
designed  to  gather  perceptual  data  from  teachers,  students, 
and  parents  was  adopted  for  use  in  this  study.  The 
population  consisted  of  680  teachers  (385  middle  school  and 
295  high  school),  4,608  students  (3,237  middle  school  and 
1,371  high  school),  and  1,626  parents  (1,074  middle  school 
and  552  high  school) . 

The  specific  research  questions  addressed  were  as  follows 

1.  Are  there  significant  differences  in  perceptions  of 
school  effectiveness  on  each  of  the  following  characteristics 
between  middle  and  high  school  teachers? 

(a)  Instructional  leadership 

(b)  Clear  and  focused  mission 

(c)  Safe  and  orderly  environment 

(d)  Positive  school  climate 

(e)  High  expectations 

(f)  Frequent  assessment /monitoring  of  student 
achievement 

(g)  Emphasis  on  basic  skills 

(h)  Maximum  opportunities  for  learning 
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(i)  Parent /community  involvement 

(j)  Strong  professional  development 

(k)  Teacher  involvement  in  decision  making 

2.  Are  there  significant  differences  in  perceptions  of 
school  effectiveness  on  each  of  the  following  characteristics 
between  middle  and  high  school  students? 

(a)  Safe  and  orderly  environment 

(b)  Positive  school  climate 

(c)  High  expectations 

(d)  Frequent  assessment /monitoring  of  student 
achievement 

(e)  Emphasis  on  basic  skills 

(f)  Maximum  opportunities  for  learning 

(g)  Parent /community  involvement 

3.  Are  there  significant  differences  in  perceptions  of 
school  effectiveness  on  each  of  the  following  characteristics 
between  middle  and  high  school  parents? 

(a)  Instructional  leadership 

(b)  Clear  and  focused  mission 

(c)  Safe  and  orderly  environment 

(d)  Positive  school  climate 

(e)  High  expectations 

(f)  Frequent  assessment /monitoring  of  student 
achievement 

(g)  Emphasis  on  basic  skills 

(h)  Maximum  opportunities  for  learning 

(i)  Parent /community  involvement 
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Conclusions  of  the  Study 

This  study  determined  that  there  were  significant 
differences  in  the  perceptions  of  teachers,  students,  and 
parents  regarding  measures  of  school  effectiveness  at  the 
middle  and  high  school  levels.  Comparisons  between 
individuals  at  the  two  levels  revealed  statistically 
significant  differences  on  three  out  of  eleven 
characteristics  measured  by  teachers,  seven  out  of  seven 
characteristics  measured  by  students,  and  seven  out  of  nine 
characteristics  measured  by  parents.  This  study  revealed  far 
more  agreement  among  teachers  at  the  two  levels  than  among 
students  and  parents  regarding  the  established  measures  of 
school  effectiveness.  The  study  also  revealed  more  critical 
opinions  and  attitudes  among  middle  and  high  school  students, 
the  only  groups  to  express  means  below  the  midpoint  of  3.00. 
These  differences  will  be  outlined  further  as  the  differences 
between  teachers,  students,  and  parents  are  discussed. 
Research  Question  One:  Differences  Between  Teacher  Groups 

The  first  research  questions  sought  to  determine  whether 
there  were  significant  differences  in  perceptions  between 
middle  and  high  school  teachers  on  11  characteristics  of 
school  effectiveness.  Significant  differences  were  found  on 
three  characteristics:  instructional  leadership, 

parent /community  involvement,  and  strong  professional 
development.  When  compared  to  middle  school  teachers,  high 
school  teachers  rated  instructional  leadership  and  strong 
professional  development  significantly  higher  than  did  middle 
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school  teachers.  For  parent /community  involvement,  middle 
school  teachers  had  more  highly  positive  perceptions  than 
high  school  teachers.  High  school  teachers  in  the  sample 
rated  instructional  leadership  and  strong  professional 
development  significantly  higher  than  did  middle  school 
teachers,  although  both  groups  rated  this  characteristic 
above  the  mean  of  3.00.  Middle  school  teachers  had 
significantly  higher  positive  perceptions  than  high  school 
teachers  of  the  characteristic  of  parent /community 
involvement,  although  both  groups  rated  this  characteristic 
above  the  rating  scale  midpoint  of  3.00.  Teachers  rated  all 
characteristics  above  the  rating  scale  midpoint  of  3.00, 
indicating  that  their  perceptions  tended  to  be  positive. 

The  difference  in  teacher  perceptions  of 
parent /community  involvement  was  probably  the  most  difficult 
of  all  differences  to  comprehend  and  discuss.  District 
records  indicated  that  the  high  school  level  had  more  parent 
participation  including  ADDitions  school  volunteers  and 
members  of  PTA  and  School  Advisory  Councils.  High  schools 
had  more  opportunities  for  parent  involvement  in  such  areas 
as  transportation  for  band,  chorus,  and  athletic  trips; 
sports  events;  and  sponsorship  of  extracurricular  activities. 
In  addition,  high  school  students  were  more  receptive  (and 
less  embarrassed)  than  middle  school  students  to  having  their 
parents  participate  as  volunteers. 

Middle  school  teachers  perceived  that  parents, 
community  members,  and  organizations  were  active  in  their 
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school.  Perhaps  the  parents  who  volunteered  to  respond  to 
the  questionnaire  were  among  those  parents  who  were  active  in 
the  school  and  this  activity  level  was  reflected  in  their 
perceptions.  The  disinterested  parents  may  not  have 
participated  in  the  survey  process. 

Teacher  perceptions  of  instructional  leadership  were 
less  positive  at  the  middle  school  than  the  high  school 
level.  Middle  schools  in  the  district  typically  had  a 
smaller  population  of  students  and  faculty,  and  these  groups 
were  more  likely  to  interact  and  work  with  school 
administrators  than  similar  groups  in  high  schools.  The 
middle  school  configuration  allowed  teachers  to  work  as  a 
team  of  three  to  a group  of  children.  Middle  school  teachers 
who  operated  as  team  members  rather  than  as  isolated  units 
were  more  likely  to  depend  on  the  school  leader  to  model  and 
support  the  team  approach.  Autonomous  high  school  teachers 
depended  little  on  interacting  with  high  school 
administrators.  Expectations  often  drive  perceptions,  and  it 
is  more  likely  that  middle  school  teachers  had  higher 
expectations  for  effective  leaders  than  did  their  more 
isolated  colleagues  in  high  schools. 

Professional  development  was  also  perceived  in  a 
different  manner  in  the  middle  schools  than  in  the  high 
schools,  which  also  influenced  teacher  expectations.  The 
school  district  made  a dramatic  and  fundamental  change  from 
junior  high  schools  to  middle  schools  in  1987,  and  this 
change  demanded  that  teachers  who  were  trained  as 
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intermediate  teachers  or  junior  high  school  teachers  learn 
new  and  different  teaching  skills,  including  counseling 
(i.e.,  "impact"  in  Orange  County),  working  in  a three-teacher 
team,  and  integrating  the  curriculum.  High  school  teachers 
have  had  far  less  demand  for  change  in  teaching  and  for 
learning  new  teaching  behaviors  and  considering  different 
curricula.  More  positive  opinions  and  attitudes  about 
professional  development  were  expressed  by  high  school 
teachers--a  group  that  had  typically  demanded  little  staff 
development  beyond  that  needed  for  certification  purposes. 
Perceptions  of  professional  development  were  less  positive 
among  the  middle  school  teacher  group  with  more  specific 
needs  for  innovative  curriculum,  instruction,  and  assessment. 
Research  Question  Two:  Differences  Between  Student  Groups 

The  second  research  question  asked  if  there  were 
significant  differences  in  perceptions  between  middle  school 
and  high  school  students  on  seven  characteristics  of  school 
effectiveness . 

Significant  differences  between  middle  and  high  school 
students  were  found  for  all  seven  measured  school 
effectiveness  characteristics.  When  compared  to  middle 
school  students,  high  school  students  rated  positive  school 
climate,  and  maximum  opportunities  for  learning  higher  than 
did  middle  school  students.  The  opposite  was  true  for  the 
characteristics  safe  and  orderly  environment,  high 
expectations,  frequent  assessment/monitoring  of  student 
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achievement,  emphasis  of  basic  skills,  and  parent /community- 
involvement  . 

Student  perceptions  varied  widely  across  the  seven 
school  effectiveness  characteristics  on  the  student  version 
of  the  survey.  Two  middle  school  student  means  and  two  high 
school  student  means  fell  below  the  rating  scale  midpoint  of 
3.00,  which  was  the  only  group  sampled  that  had  means  below 
the  rating  scale  midpoint.  The  characteristic  of  positive 
school  climate  was  rated  below  the  rating  scale  midpoint  by 
both  levels  of  students.  Positive  school  climate  reflects  an 
ambiance  of  trust,  respect,  and  caring.  Safety  and  trust  are 
issues  of  public  interest.  A review  of  district  records 
revealed  that  student  discipline  referrals  have  increased, 
possibly  contributing  to  less  trust  and  respect  between 
students  and  their  classmates  and  students  and  teachers.  The 
characteristic  of  maximum  opportunities  for  learning  was 
rated  below  the  rating  scale  midpoint  by  middle  school 
students  despite  the  middle  school  mission  of  serving  the 
needs  of  individual  students.  The  characteristic  of 
parent /community  involvement  was  rated  below  the  rating  scale 
midpoint  by  high  school  students,  indicating  that  students 
did  not  perceive  a high  involvement  by  parents  and  community 
members  despite  district  records  showing  that  many  parents 
supported  extracurricular  activities,  sports  events,  and  band 
and  chorus  trips . 

The  mean  was  significantly  higher  among  middle  school 
students  for  the  characteristic  of  safe  and  orderly 
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environment.  The  middle  school  students  perceived  that  there 
is  a higher  degree  of  safety,  trust,  respect,  and  caring 
among  middle  school  administrators,  faculty,  students,  and 
parents.  High  school  student  means  were  significantly  higher 
for  the  characteristics  of  maximum  opportunities  for 
learning,  which  reflect  school  activities  that  met  the  needs, 
interests,  and  abilities  of  all  students,  and  positive  school 
climate.  The  higher  means  here  may  reflect  the  nature  of  the 
high  school,  which  includes  more  choice  for  students  in 
academic  and  technical  subjects,  numerous  extracurricular 
clubs  and  organizations,  different  sports,  and  opportunities 
for  attending  magnet  schools  and  technical  (formerly 
vocational)  schools. 

Middle  school  student  responses  had  significantly  higher 
means  for  high  expectations,  frequent  assessment /monitoring 
of  student  achievement,  and  emphasis  on  basic  skills.  These 
variables  directly  reflect  the  academic  and  instructional 
core  of  schools.  The  higher  means  of  middle  school  students 
may  reflect  the  difference  between  the  configuration  of  the 
middle  school  and  that  of  the  high  school . At  the  middle 
school,  teachers  operate  in  teams  with  the  same  group  of 
students  for  the  year.  Courses  are  less  fragmented  (e.g., 
duration  of  courses  is  more  likely  to  be  a full  year  rather 
than  a portion  of  the  year) . Such  conditions  may  provide 
more  opportunity  for  middle  school  teachers  to  express  high 
expectations,  keep  track  of  student  progress  and  communicate 
student  progress,  and  concentrate  on  development  of 
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appropriate  skills  for  content  areas.  Middle  school  students 
also  had  significantly  higher  means  for  parent /community 
involvement,  which  paralleled  middle  school  parents' 
responses  to  this  variable.  Students  also  perceived  that  the 
school  actively  sought  parent /community  involvement  and  that 
parents  and  other  community  members  supported  the  school ' s 
activities  and  functions. 

Research  Question  Three:  Differences  Between  Parent  Groups 

The  third  research  question  sought  to  determine  whether 
there  were  significant  differences  between  middle  and  high 
school  parents  in  their  perception  of  nine  characteristics  of 
school  effectiveness.  Significant  differences  were  found  on 
seven  of  the  nine  characteristics  of  school  effectiveness. 
Middle  school  parents  rated  clear  and  focused  mission,  safe 
and  orderly  environment,  positive  school  climate,  high 
expectations,  frequent  assessment /monitoring  of  student 
achievement,  maximum  opportunities  for  learning  and 
parent /community  involvement  higher  than  did  high  school 
parents.  Significant  differences  between  middle  and  high 
school  parents  were  not  found  for  the  following 
characteristics:  instructional  leadership  and  emphasis  on 

basic  skills.  The  former  finding  may  be  due  to  similar  lack 
of  information  regarding  instructional  leadership  by  parents 
at  both  levels.  The  latter  finding  may  be  due  to  similar 
lack  of  information  regarding  instructional  leadership  by 
parents  at  both  levels.  These  findings  must  be  discussed  in 
the  context  of  the  similarity  of  the  shape  of  the 
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distributions  of  the  variables  and  noting  that  the  lowest 
mean  was  3.47  for  middle  school  parents  and  3.25  for  high 
school  parents  (parent /community  involvement).  Both  of  the 
lowest  means  were  higher  than  the  rating  scale  midpoint  of 
3.00.  These  data  indicate  that  middle  school  parents  were  in 
higher  agreement  than  high  school  parents  on  the 
characteristics  of  effective  schools.  One  third  of  the  items 
on  the  parent  version  of  the  effective  schools  indicators 
focused  on  communication  between  parents  and  school 
personnel.  Further  examination  of  the  results  revealed  that 
middle  school  parents  perceived  that  there  was  frequent 
communication  between  parents,  faculty  and  administration; 
that  parents  and  students  were  aware  of  school  purposes  and 
goals;  that  teachers  told  students  what  they  were  expected  to 
learn;  that  students  were  informed  on  how  they  were  expected 
to  behave  in  school  and  at  school  activities;  that  parents 
were  involved  in  and  supported  school  discipline  practices; 
that  students  were  taught  to  act  in  a safe  and  responsible 
manner;  and  that  the  school  used  input  from  interested 
parents.  Such  items  imply  communication  of  school 
information  and  student  code  of  conduct  expectations.  The 
middle  school  configuration  may  allow  for  better 
communication  beginning  with  the  foundation  of  teacher  teams 
that  communicate  with  each  other  about  a group  of  students. 
The  characteristic  of  parent/community  involvement  was 
somewhat  puzzling  since  the  volunteer  participation  and  PTA 
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membership  in  middle  schools  is  known  to  be  less  than  at  high 
schools . 

Additional  Differences 

This  study  focused  on  three  research  questions 
concerning  the  perceptions  of  middle  school  and  high  school 
teachers,  students,  and  parents  on  selected  indicators  of 
school  effectiveness.  The  research  questions  compared  only 
like  groups  across  the  two  levels  of  secondary  education. 

The  data  also  revealed  other  information  of  interest  and  this 
information  is  discussed  here. 

Means  for  middle  school  parent  responses  were  higher 
than  middle  school  teacher  means  for  the  characteristics  of 
instructional  leadership,  clear  and  focused  mission,  safe  and 
orderly  environment,  positive  school  climate,  high 
expectations,  frequent  assessment/monitoring  of  student 
achievement,  and  emphasis  on  basic  skills.  The  standard 
deviations  of  the  parent  group  responses  for  each 
characteristic  on  the  parent  survey  were  more  similar  than 
those  of  the  teacher  group  responses  (deviations  in  the 
parent  range  difference  of  .13  was  less  than  the  teacher 
range  of  . 20 ) . 

The  response  means  for  most  middle  school  students  were 
lower  than  those  of  middle  school  teachers  and  parents.  The 
student  groups  had  the  only  four  means  that  fell  below  the 
midpoint  of  3.00.  Middle  school  student  means  for  positive 
school  climate  (2.76)  and  maximum  opportunities  for  learning 
(2.94)  were  rated  below  the  midpoint  of  3.00.  High  school 
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student  means  for  positive  school  climate  (2.82)  and  parent 
community  involvement  (2.78)  were  rated  below  the  midpoint  of 
3.00.  Standard  deviations  were  more  varied  among  middle 
school  students  than  among  middle  school  teachers  and 
parents.  The  range  difference  of  characteristics  was  .43. 

The  high  school  student  means  were  lower  than  those  of 
high  school  teachers  and  parents  on  six  of  the  seven 
characteristics  measured.  The  only  characteristic  rated 
higher  by  high  school  students  than  by  high  school  teachers 
and  parents  was  high  expectations.  No  high  school  student 
means  reached  4.00  or  above. 

Recommendations  and  Implications  For  Further  Study 

There  is  no  one  correct  strategy  or  model  of  school 
effectiveness  and  there  are  few  data  to  evaluate  the  specific 
outcomes  of  any  of  the  models.  Yet,  with  widespread  public 
dissatisfaction  with  the  perceived  outcomes  of  public 
education,  ways  must  be  found  to  continue  to  improve  public 
school  systems.  Perceptions  of  school  effectiveness  between 
levels  for  teachers,  students,  and  parents  provide  a basis 
for  evaluation  and  future  planning.  Strategic  school 
improvement  plans,  referencing  research-based  characteristics 
of  effective  schools,  could  direct  individual  secondary 
schools  toward  implementing  programs  and  initiatives  related 
to  improving  student  achievement. 

Recommendations  are  as  follows: 

1.  Principals  should  develop  an  action  plan  for 
disseminating  building  level  results  of  the  school 
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effectiveness  surveys  to  school  administrators,  support 
staff,  teachers,  students  and  parents.  An  action  plan  should 
also  include  activities  to  address  those  characteristics  with 
means  below  the  building  level  midpoint  and  any  other 
characteristics  of  concern  to  faculty,  students,  and 
teachers . 

2.  Schools  should  establish  an  effectiveness  team 
composed  of  teachers,  students  and  parents  who  will  review 
survey  data.  From  the  results,  the  team  should  assist  in 
developing  priorities  and  action  plans  for  improvement  based 
on  the  perceptions  teachers,  students,  and  parents  have  of 
the  school  and  where  the  team  would  like  to  guide  the  school, 
based  on  effective  school  research. 

3 . School  personnel  should  create  a learning 
environment  that  is  open,  friendly,  and  culturally  inviting. 
Such  as  egalitarian  environment  fosters  the  characteristics 
of  effective  schools. 

4.  School  personnel  should  improve  parent  participation 
by  establishing  good  communication  between  the  school  and  the 
home,  keeping  parents  up  to  date  about  student  performance, 
and  involving  parents  in  their  children's  learning  through 
volunteering,  signing  homework,  and  stressing  home  learning. 

5.  Teachers  should  actively  engage  students  in  learning 
by  involving  students  in  discussing  issues  related  to  the 
topic,  and  writing  about  personal  experiences,  creating 
original  stories,  and  solving  complex  problems.  Students 
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need  to  do  much  independent  reading  and  writing  and  make 
extensive  use  of  the  school  media  services. 

6.  District  personnel  should  design  and  implement 
inservice  programs  for  school  leaders  and  decision  makers 
regarding  methods  of  addressing  perceived  deficiencies 
(i.e.,  any  indicators  less  than  3.49)  in  results  of  school 
effectiveness  surveys.  Such  programs  can  also  be  useful  in 
the  district  Preparing  New  Principals  Program. 

In  addition  to  the  recommendations  resulting  from  this 
study,  implications  for  further  research  are  also  in  order. 
Because  the  study  indicated  that  the  educational  leadership 
of  the  principal  was,  perhaps,  the  most  important 
characteristic  of  school  effectiveness,  more  work  is  needed 
in  this  area  to  augment  the  original  indicators  of  school 
effectiveness.  Of  particular  interest  would  be  the 
measurement  of  issues  readily  identified  by  teachers, 
students,  and  parents,  issues  that  are  clearly  under  the 
control  of  the  principal.  Feedback  information  on  these 
issues  would  provide  a practical  means  for  improving  schools. 
The  instruments  could  measure  the  perceptions  of  teachers, 
students,  and  parents  and  focus  upon  specific  outcomes  of  the 
building  level  principal.  In  order  to  deal  with  differential 
perceptions,  data  may  be  coded  so  that  data  analysis  by  the 
main  categories  of  ethnicity  could  be  done  if  necessary. 


APPENDIX  A 

SCHOOL  EFFECTIVENESS  CHARACTERISTICS  & INDICATORS 

QUESTIONNAIRE 

TEACHER  VERSION 

This  questionnaire  is  designed  to  give  teachers  the  opportunity 
to  provide  information  about  how  they  perceive  their  school  in 
relation  to  11  important  characteristics  that  describe 
effective  schools.  Contained  here  are  67  indicators  of  school 
effectiveness  that  represent  the  following  characteristics: 

1.  Instructional  Leadership 

2 . Clear  and  Focused  Mission 

3 . Safe  and  Orderly  Environment 

4.  Positive  School  Climate 

5.  High  Expectations 

6.  Frequent  Assessment/Monitoring  of  Student  Achievement 

7.  Emphasis  on  Basic  Skills 

8.  Maximum  Opportunities  for  Learning 

9.  Parent /Community  Involvement 

10.  Strong  Professional  Development 

11.  Teacher  Involvement  in  Decision-Making 

INSTRUCTIONS 

•Do  not  write  on  this  questionnaire. 

•Record  your  answers  on  the  accompanying  General  Purpose- - 
NCS  Answer  Sheet.  In  order  for  your  answers  to  be  read  by 
our  scanner,  a soft  black  lead  pencil  must  be  used. 

Ballpoint  or  ink  pens  cannot  be  scanned  on  our  equipment. 

•Before  responding  to  the  statements,  bubble  your  four-digit 
number  in  special  codes  K-N  (see  lower  left  section  of  side 
1 of  the  answer  sheet) . For  example,  a school  with  a 
leading  zero  such  as  0451  would  bubble  0 in  special  code  K 
followed  by  4 , 5 and  1 in  special  codes  L-N,  respectively. 

•If  your  school  has  chosen  to  have  the  results  analyzed  by 
sex,  use  the  field  at  the  top  center  of  side  1.  M = male 
and  F = female.  To  have  the  results  analyzed  by  race, 
please  bubble  special  code  P according  to  these  codes: 

1 = White,  non-Hispanic 

2 = Black,  non-Hispanic 

3 = Hispanic,  White  or  Black 

4 = Asian/Pacific  Islander 

5 = American  Indian/Alaska  Native 
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Indicators  of  School  Effectiveness 

•Use  the  following  scale  for  all  responses: 

1 2 2 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

1.  Administrators  are  knowledgeable  of  the  school  and 
district  curriculum. 

2.  Frequent  communication  occurs  between  faculty  and 
administration . 

3 . Instructional  decisions  for  the  school  are  based  on 
community,  teacher,  and  central  administration  input. 

4.  The  principal  is  involved  in  the  instructional  process. 

5.  The  principal  and  teachers  make  instructional 
effectiveness  the  highest  priority  in  the  school. 

6.  The  principal  assumes  leadership  for  improving  the 
instructional  program. 

7.  Administrators  complete  fair  and  meaningful  evaluations 
of  each  employee. 

8.  The  principal  encourages  teachers  to  participate  in 
leadership  roles. 

9 . A school  plan  for  the  year  exists  which  includes  goals 
and  objectives. 

10.  The  school  plan  is  developed  with  teachers  and  community 
members . 

11.  Important  social  trends  are  considered  in  the  school 
planning . 

12 . Teachers  and  students  are  aware  of  school  purposes  and 
goals . 

13 . The  goals  of  teachers  are  consistent  with  school  and 
district  goals. 

14.  Teachers  communicate  instructional  goals  to  students. 

15.  The  school  plan  is  revised,  monitored,  and  reviewed 
periodically . 

16.  School  conduct  rules  and  procedures  are  taught  along  with 
other  skills. 
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1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

17.  Disciplinary  procedures  are  implemented  in  a fair  and 
consistent  matter. 

18.  Parents  are  involved  in  and  support  school  discipline 
practices . 

19.  The  physical  plant  is  clean  and  well  maintained. 

20.  Appropriate  safety  principles  are  taught  and  practiced. 

21.  An  atmosphere  of  respect  and  trust  exists. 

22.  Social  and  cultural  differences  are  respected. 

23.  Students  and  teachers  have  a positive  attitude  toward 
school . 

24.  Teacher  and  student  attendance  is  high. 

25.  Students  and  teachers  are  recognized  for  their 
accomplishments . 

26.  Teachers,  students,  and  administrators  assume 
responsibility,  as  appropriate,  for  the  physical 
appearance  of  the  school. 

27.  School  facilities  contribute  to  positive  school  climate. 

28.  Expectations  are  high,  appropriate,  and  achievable. 

29.  Expectations  are  communicated  to  faculty,  support  staff, 
students,  and  parents. 

30.  Success  is  expected  of  all  students  regardless  of  social 
or  cultural  differences. 

31.  Expectations  for  students  are  based  on  knowledge  of 
students  and  their  previous  performance. 

32.  High  expectations  are  consistently  maintained  over  time. 

33.  Student  performance  is  regularly  monitored. 

34.  Student  performance  is  monitored  in  a variety  of  ways. 

35.  Assessment  data  are  used  to  improve  the  school's  program. 

36.  Student  progress  is  regularly  reported  to  parents. 
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1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

37.  Student  assessment  data  are  monitored  to  modify 
instruction  to  promote  student  learning. 

38.  Students  are  regularly  informed  of  their  progress. 

39.  Basic  skills  are  defined  as  including  minimum  student 
performance  standards,  grade-appropriate  skills  within 
content  areas,  critical/higher-order  thinking  skills,  and 
problem-solving  skills.  Basic  skills  in  any  school  fit 
this  definition. 

40.  Students  are  taught  to  apply  basic  skills. 

41.  Basic  skills  are  assessed  for  content  and  process 
application . 

42.  Electives  and  "specials"  are  integrated  into  the  school 
curriculum. 

43 . The  integration  of  basic  skills  into  instruction  is 
consistently  monitored. 

44.  Appropriate  instructional  time  is  maximized. 

45.  Disruptions  to  instruction  are  minimized. 

46.  Transitions  are  effectively  managed. 

47.  Extracurricular  and  supplemental  activities  support 
instruction . 

48.  The  curriculum  is  varied  to  accommodate  needs,  interests, 
and  abilities  of  students. 

49.  Cooperative  learning  opportunities  are  provided. 

50.  Parents  actively  participate  in  establishing  school 
policies  and  procedures. 

51.  Parents  actively  participate  in  school  activities. 

52.  Effective  and  frequent  communication  occurs  with  parents. 

53 . Community  resources  are  used  to  support  the  school ' s 
program . 

54.  Social  services  from  available  outside  agencies  are 
effectively  utilized. 
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1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

55.  Parents  are  encouraged  to  support  the  instructional 
activities  of  the  school. 

56.  Professional  development  addresses  the  social  and 
cultural  differences  in  the  school. 

57.  Professional  development  is  tailored  to  the  needs  of  the 
school . 

58.  Teachers  are  involved  in  planning  and  evaluating 
professional  development  activities. 

59.  The  importance  of  professional  development  is  emphasized. 

60.  The  application  of  professional  development  activities  is 
encouraged . 

61.  Feedback  is  sought  from  participants  in  professional 
development  activities. 

62 . Teachers  strive  to  maintain  and  enhance  their 
professional  status. 

63.  Teachers  are  involved  in  school  planning  and  budgeting. 

64.  Teachers  are  involved  in  developing  and  reviewing  the 
school's  mission  and  goals. 

65.  Teachers  are  involved  in  monitoring  the  implementation  of 
school  policies  and  procedures. 

66.  Teachers  perceive  that  they  can  influence  school 
decisions . 

67.  Teachers  and  administrators  function  as  a team. 


APPENDIX  B 

SCHOOL  EFFECTIVENESS  CHARACTERISTICS  & INDICATORS 

QUESTIONNAIRE 

STUDENT  VERSION 

This  questionnaire  is  designed  to  give  students  the 
opportunity  to  provide  information  about  how  they  perceive 
their  school  in  relation  to  seven  important  characteristics 
that  describe  effective  schools.  Contained  here  are  33 
indicators  of  school  effectiveness  that  represent  the 
following  characteristics: 

1.  Safe  and  Orderly  Environment 

2 . Positive  School  Climate 

3 . High  Expectations 

4.  Frequent  Assessment/Monitoring  of  Student  Achievement 

5.  Emphasis  on  Basic  Skills 

6.  Maximum  Opportunities  for  Learning 

7.  Parent /Community  Involvement 

Instructions 

Here  is  a list  of  things  that  happen  in  good  schools. 

We  need  for  students  like  you  to  help  us  find  out  what  kinds 
of  things  are  happening  in  your  school.  Your  answers  will 
help  your  principals  and  teachers  make  your  school  even 
better.  Thank  you  for  your  help. 

Directions : 

•Put  all  your  answers  on  the  General  Purpose- -NCS  Answer 
Sheet.  You  must  use  a soft  black  lead  pencil  (no  ballpoint 
or  ink  pens) . 

•Before  responding  to  each  statement,  fill  in  the  left 
portion  of  the  answer  sheet.  Your  teachers  can  help  you  if 
you  have  questions  about  the  form. 

•You  will  see  a place  for  your  NAME.  Leave  that  blank. 

•Right  by  the  blue  column  you  will  see  SEX.  Leave  that 
blank,  also.  Move  down  to  GRADE.  Fill  in  the  number  that 
is  your  grade. 

•Skip  BIRTHDATE  and  IDENTIFICATION  NUMBER. 
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•in  SPECIAL  CODES  K-N,  bubble  in  your  school  number.  Your 
teacher  will  give  it  to  you.  Leave  SPECIAL  CODES  0 and  P 
blank . 

Now  you  are  ready  to  begin  the  survey.  There  are  no  right  or 
wrong  answers  to  the  items. 

SPECIAL  INSTRUCTIONS: 

•Read  each  statement  carefully. 

•Respond  based  on  how  you  feel. 

•Leave  blank  items  you  do  not  understand. 

•Use  the  following  scale  for  all  responses: 

1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

Here  are  two  examples : 

1.  I like  school  sports. 

1 2 3 4 5 

2.  I circumnavigate  the  environmental  fixtures. 

1 2 3 4 5 

Bubbling  a 5 for  item  1 means  that  the  student  strongly 
agrees  with  the  statement  that  he/she  likes  sports.  Not 
bubbling  any  answer  for  item  2 means  that  the  student  does 
not  understand  the  second  statement. 

Leave  blank  items  you  do  not  understand 

1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

Respond  to  the  following  statements: 

1.  At  my  school  I am  taught  how  to  behave. 

2.  School  conduct  rules  are  fair. 

3.  My  parents  know  about  the  school's  discipline  rules. 

4.  My  parents  support  the  school's  discipline  rules. 

5.  My  school  building  is  clean  and  most  everything  works. 

6.  I know  the  school  safety  rules  (for  the  bus,  playground, 
classroom) . 
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1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

7.  Safety  rules  are  enforced. 

8.  The  school  safety  rules  are  obeyed. 

9 . Teachers  and  students  respect  and  trust  each  other  at  my 
school . 

10.  Teachers  respect  all  students  at  our  school,  no  matter 
who  they  are . 

11.  Students  are  not  absent  from  school  often. 

12 . The  school  gives  credit  to  students  and  teachers  for  the 
good  things  they  do . 

13.  Everyone  at  school  takes  good  care  of  the  school. 

14.  I feel  safe  at  school. 

15.  I am  proud  of  the  way  my  school  looks. 

16.  My  teachers  expect  me  to  do  my  best. 

17.  My  teachers  expect  all  students  to  succeed,  no  matter  who 
they  are. 

18.  My  teachers  expect  me  to  learn  as  much  as  I can. 

19.  My  teachers  keep  track  of  how  I am  doing  in  my  school 
work . 

20.  The  grades  I get  are  fair. 

21.  My  teachers  tell  me  how  I am  doing  in  my  school  work. 

22 . My  teachers  send  home  information  to  my  parents  about  my 
progress . 

23.  My  reading,  writing,  and  mathematics  classes  are 
important . 

24.  I enjoy  special  classes,  such  as  music  and  art. 

25.  I use  what  I learn  in  reading,  writing,  and  math. 

26.  I have  enough  time  to  study  in  class. 

27.  Classes  are  not  often  interrupted  by  other  people. 

28.  I often  work  with  other  students  on  class  projects. 


1 2 

Strongly  Disagree 


3 

Neutral 


4 


5 

Strongly  Agree 
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29.  I am  interested  in  the  courses  I take. 

30.  My  textbooks  and/or  workbooks  are  interesting. 

31.  After-school  activities  help  me  to  become  a better 
student . 

32.  My  parents  are  active  in  school  events. 

33.  My  parents  know  what  is  going  on  in  the  school. 


APPENDIX  C 

SCHOOL  EFFECTIVENESS  CHARACTERISTICS  & INDICATORS 

QUESTIONNAIRE 

PARENT  VERSION 

This  questionnaire  is  designed  to  give  parents  the 
opportunity  to  provide  information  about  how  they  perceive 
their  school  in  relation  to  nine  important  characteristics 
that  describe  effective  schools.  Contained  here  are  42 
indicators  of  school  effectiveness  that  represent  the 
following  characteristics: 

1.  Instructional  Leadership 

2 . Clear  and  Focused  Mission 

3 . Safe  and  Orderly  Environment 

4.  Positive  School  Climate 

5.  High  Expectations 

6.  Frequent  Assessment/Monitoring  of  Student  Achievement 

7.  Emphasis  on  Basic  Skills 

8.  Maximum  Opportunities  for  Learning 

9.  Parent /Community  Involvement 


INSTRUCTIONS 

•Do  not  write  on  this  questionnaire. 

•Record  your  answers  on  the  accompanying  General  Purpose-- 
NCS  Answer  Sheet . In  order  for  your  answers  to  be  read  by 
our  scanner,  a soft  black  lead  pencil  must  be  used. 

Ballpoint  or  ink  pens  cannot  be  scanned  on  our  equipment. 

•Before  responding  to  the  statements,  bubble  your  four-digit 
school  number  in  special  codes  K-N  (see  lower  left  section 
of  side  1 of  the  answer  sheet) . For  example,  a school  with 
a leading  zero  such  as  0451  would  bubble  0 in  special  code  K 
followed  by  4 , 5,  and  1 in  special  codes  L-N,  respectively. 

•If  your  school  has  chosen  to  have  the  results  analyzed  by 
race,  please  enter  your  race  in  special  code  P according  to 
these  codes : 

1 = White,  non-Hispanic 

2 = Black,  non-Hispanic 

3 = Hispanic,  White  or  Black 

4 = Asian/Pacific  Islander 

5 = American  Indian/Alaska  Native 
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Indicators  of  School  Effectiveness 

•Use  the  following  scale  for  all  responses: 

1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

1.  The  principal  and  assistant  principals  know  the  school 
and  the  courses  that  should  be  taught . 

2.  Frequent  communication  occurs  between  parents,  faculty, 
and  administration. 

3.  Decisions  about  instruction  use  information  from  parents, 
community,  and  teachers. 

4.  The  principal  has  a strong  role  in  instruction. 

5.  The  principal  and  teachers  make  good  instruction  the  most 
important  school  priority. 

6.  The  principal  is  the  leader  for  improving  instruction  in 
the  school. 

7 . The  school  has  a written  plan  which  indicates  what  the 
school  is  trying  to  achieve. 

8.  The  plan  is  developed  with  teachers  and  interested 
parents  such  as  the  PTA  and  the  PTO. 

9.  Parents  and  students  are  aware  of  school  purposes  and 
goals . 

10.  Teachers  tell  students  what  they  are  expected  to  learn. 

11.  Students  are  informed  how  they  are  expected  to  behave  in 
school  and  at  school  activities. 

12.  Students  are  disciplined  in  a fair  and  consistent  matter. 

13 . Parents  are  involved  in  and  support  school  discipline 
practices . 

14.  The  school  buildings  and  grounds  are  clean  and  well 
maintained . 

15.  Students  are  taught  to  act  in  a safe  and  responsible 
manner . 

16.  An  atmosphere  of  respect  and  trust  exists. 

17.  Social  and  cultural  differences  are  respected. 


88 


1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

18.  Students  and  teachers  have  a positive  attitude  toward 
school . 

19.  Students  are  recognized  for  their  accomplishments. 

20.  School  staff  members  and  students  work  together  to  keep 
the  school  clean  and  attractive. 

21.  Students  and  others  feel  that  school  is  a good  place  to 
be . 

22.  School  staff  members  set  high,  but  appropriate  and 
achievable,  goals  for  students. 

23 . Students  and  parents  know  what  the  school  expects  of 
them. 

24.  Success  is  expected  of  all  students  regardless  of  social 
or  cultural  differences. 

25.  The  school  keeps  track  of  each  student's  performance. 

26.  Student  performance  is  judged  in  a variety  of  ways. 

27.  Parents  are  kept  aware  of  how  well  their  children  are 
doing  in  school. 

28.  Students  are  kept  aware  of  how  well  they  are  doing  in 
school . 

29.  Students  are  taught  to  apply  basic  skills  such  as 
reading,  writing,  mathematics,  science,  social  studies, 
and  problem-solving  skills. 

30.  Along  with  regular  classes,  the  school  makes  available  to 
students  enrichment  activities  and  classes  for  students 
with  special  needs  or  interests. 

31.  Teachers  spend  as  much  time  on  instruction  as  needed. 

32.  There  are  few  disruptions  to  instruction  in  the  school. 

33.  Activities  outside  of  the  classroom  are  used  to  support 
instruction . 

34.  School  courses  are  varied  to  meet  the  different  needs, 
interests,  and  abilities  of  students. 

35.  Students  are  allowed  to  learn  with  and  from  each  other. 
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1 2 3 4 5 

Strongly  Disagree  Neutral  Strongly  Agree 

36.  The  school  uses  input  from  interested  parents,  PTA's  and 
PTO's  in  developing  school  policies. 

37.  Interested  parents  and  parent  groups  actively  participate 
in  school  activities. 

38.  Parents  and  school  personnel  talk  to  each  other 
frequently . 

39.  Parents  are  encouraged  to  support  the  instructional 
activities  of  the  school. 

40.  Parents  are  involved  in  the  development  of  school 
budgets . 

41.  The  school  gives  parents  good  news  about  the  achievement 
and  behavior  of  their  children. 

42.  The  school  quickly  gives  parents  necessary  information 
when  student  achievement  or  behavior  is  below 
expectations . 
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